00000001:02000400:0.0F:1787572137.671212:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_hostid 00000001:02000400:0.0:1787572159.532138:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787572161.488176:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 703 MB/s 00000001:01000000:2.0F:1787572161.739043:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 605 MB/s 00000001:01000000:2.0:1787572161.989214:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4439 MB/s 00000020:02000000:0.0:1787572162.939165:0:3278:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g9b8a413 00000400:02000000:1.0F:1787572163.900063:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.155@tcp [8/256/0/180] 00008000:02000000:0.0:1787572168.090283:0:3443:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787572226.319492:0:5247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787572236.963533:0:5823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787572236.963544:0:5823:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787572236.964052:0:5823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ee49a781 00000080:02000400:3.0:1787572236.964067:0:5823:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787572236.969741:0:5823:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787572236.969758:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787572236.969871:0:5823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f7867f6e) 00000020:00000080:3.0:1787572236.969901:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787572236.998213:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787572236.999168:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787572237.084060:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787572237.084190:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787572237.084215:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787572237.084556:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787572237.084590:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787572237.085567:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787572237.085578:0:5823:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787572237.085593:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f435fc5 00000020:01000004:2.0:1787572237.085604:0:5823:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787572237.085610:0:5823:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787572237.085615:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ee49a781 from MGS 00000020:01000004:2.0:1787572237.085622:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787572237.085766:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000051ceb6e1) 00000020:00000080:2.0:1787572237.085783:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787572237.085869:0:5823:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ee49a781 from MGS, refs=2 00080000:01000000:2.0:1787572237.085876:0:5823:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787572237.085887:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f435fd3 00000100:00100000:2.0:1787572237.086057:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787572237.086305:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787572237.086314:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787572237.087234:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787572237.087243:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787572237.089823:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787572237.091514:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787572237.091525:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787572237.094659:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787572237.094676:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787572237.097067:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787572237.097154:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787572237.105673:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572237.105683:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572237.105686:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572237.106879:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572237.106884:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572237.106886:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572237.107918:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787572237.113993:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787572237.358843:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1956 MB/s 00000001:01000000:2.0:1787572237.608980:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3171 MB/s 00000001:01000000:0.0:1787572237.859125:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 563 MB/s 00000001:01000000:2.0:1787572238.109547:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 859 MB/s 00080000:10000000:2.0:1787572238.118425:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787572238.127160:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787572238.139279:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787572238.139298:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787572238.139301:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787572238.140054:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787572238.140123:0:5823:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787572238.140171:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787572238.140381:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787572238.140406:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787572238.140788:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787572238.141009:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787572238.141016:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787572238.142147:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787572238.142157:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787572238.155295:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787572238.155311:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787572238.158730:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787572238.158757:0:5823:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.155@tcp' 00000020:01000004:1.0:1787572238.158759:0:5823:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787572238.158820:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.155@tcp (typ=mgc) 00000020:00000080:1.0:1787572238.158838:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.155@tcp (00000000b0b7b043) 00000020:00000080:1.0:1787572238.158859:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787572238.159003:0:5823:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000973857cb@MGC192.168.204.155@tcp: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1787572238.159164:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.155@tcp-0 is initialized 00000040:01000000:1.0:1787572238.159169:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787572238.161831:0:5838:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787572238.164935:0:5839:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787572238.164990:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.155@tcp (uuid 9d30d720-8336-413c-aa2f-3c1df9a74652) 00000020:00000080:0.0:1787572238.165017:0:5823:0:(genops.c:1385:class_connect()) connect: client 9d30d720-8336-413c-aa2f-3c1df9a74652, cookie 0x9fe530ef4f435fe1 00000100:00080000:0.0:1787572238.165032:0:5823:0:(import.c:510:import_select_connection()) MGC192.168.204.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787572238.165038:0:5823:0:(import.c:624:import_select_connection()) MGC192.168.204.155@tcp: import 00000000973857cb using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1787572238.165095:0:5823:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ea7bf7fa x1874405268390016/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787572238.165129:0:5823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS 00000020:01000004:0.0:1787572238.165151:0:5823:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787572238.165173:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787572238.165196:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000310cbccb) 00000020:00000080:0.0:1787572238.165211:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787572238.165554:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea7bf7fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30d720-8336-413c-aa2f-3c1df9a74652:3309:1874405268390016:0@lo:250: 00000100:00100000:3.0:1787572238.165740:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572238.167067:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268390016 00000100:00100000:2.0:1787572238.167081:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268390016 00000100:00100000:2.0:1787572238.167121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572238.167129:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000437519cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874405268390016:12345-0@lo:250: 00010000:00080000:2.0:1787572238.167171:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9d30d720-8336-413c-aa2f-3c1df9a74652@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1787572238.167215:0:5835:0:(genops.c:1385:class_connect()) connect: client 9d30d720-8336-413c-aa2f-3c1df9a74652, cookie 0x9fe530ef4f435fef 00000100:00080000:2.0:1787572238.167413:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000408acc2c : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572238.167508:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000437519cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+5:3309:x1874405268390016:12345-0@lo:250: Request processed in 378us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572238.167517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572238.167587:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787572238.167605:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.155@tcp: connect to target with instance 0 00000100:00080000:2.0:1787572238.167621:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787572238.167626:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787572238.167629:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000973857cb MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787572238.167663:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787572238.167670:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787572238.167676:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea7bf7fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30d720-8336-413c-aa2f-3c1df9a74652:3309:1874405268390016:0@lo:250: 00000100:00100000:0.0:1787572238.187319:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787572238.187934:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787572238.187941:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787572238.188803:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787572238.188812:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787572238.189192:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787572238.189200:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787572238.189962:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787572238.190130:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787572238.190144:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787572238.190511:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787572238.190517:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787572238.242630:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787572238.243250:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787572238.243256:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787572238.245382:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787572238.245395:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787572238.246463:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787572238.247127:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787572238.247133:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787572238.248104:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787572238.248117:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787572238.249143:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787572238.249332:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787572238.249337:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787572238.250211:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787572238.250219:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787572238.252201:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787572238.252375:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787572238.252381:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787572238.253165:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787572238.253180:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787572238.286336:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787572238.286784:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787572238.286791:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787572238.289482:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787572238.289500:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787572238.290684:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787572238.290761:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787572238.294103:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787572238.294134:0:5823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787572238.294141:0:5823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787572238.294266:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787572238.294301:0:5823:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.155@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787572238.294305:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787572238.294307:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787572238.294309:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572238.294310:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572238.294311:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572238.294313:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572238.294314:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787572238.294316:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787572238.294317:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787572238.294318:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787572238.294320:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572238.294321:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787572238.294323:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787572238.294325:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787572238.294326:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787572238.294332:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572238.294332:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572238.294333:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572238.294334:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572238.294335:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787572238.294336:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787572238.294337:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787572238.294338:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787572238.294338:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572238.294339:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787572238.294373:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787572238.294389:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c543b0e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390144:0@lo:253: 00000100:00100000:1.0:1787572238.294459:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572238.294595:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268390144 00000100:00100000:0.0:1787572238.294604:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268390144 00000100:00100000:0.0:1787572238.294660:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787572238.294683:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001df0900b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+5:5823:x1874405268390144:12345-0@lo:253: 20000000:01000000:0.0:1787572238.294740:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787572238.294743:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:1.0:1787572238.295043:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f912a35d going to sleep for 11 seconds 10000000:01000000:1.0:1787572238.295954:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787572238.296016:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787572238.296437:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787572238.298156:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787572238.298397:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787572238.298402:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787572238.298409:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787572238.298412:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787572238.298428:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787572238.298994:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787572238.299297:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787572238.299311:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787572238.299359:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787572238.299427:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787572238.299471:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787572238.300218:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787572238.300230:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787572238.300282:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787572238.300291:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787572238.300341:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787572238.300349:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787572238.300395:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787572238.300449:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787572238.300600:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787572238.301027:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787572238.301214:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787572238.302004:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787572238.302022:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787572238.302065:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787572238.302172:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787572238.302223:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787572238.302237:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787572238.302321:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787572238.302330:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787572238.302389:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787572238.302424:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787572238.302463:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787572238.302475:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787572238.302907:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787572238.302929:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787572238.302962:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787572238.302996:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787572238.303237:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787572238.303285:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787572238.303293:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787572238.304284:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787572238.305038:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787572238.305063:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.155@tcp for mdt 20000000:01000000:2.0:1787572238.305065:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:2.0:1787572238.305113:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787572238.305121:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787572238.305171:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787572238.305179:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:2.0:1787572238.305225:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787572238.305237:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787572238.305267:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787572238.305302:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787572238.305364:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787572238.305368:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787572238.305371:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787572238.305383:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787572238.305385:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787572238.305418:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787572238.305420:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787572238.306326:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787572238.306880:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787572238.306942:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787572238.306980:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787572238.306997:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787572238.306999:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787572238.307984:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787572238.308338:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787572238.308404:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787572238.308469:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1787572238.308482:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787572238.308499:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787572238.308504:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787572238.308506:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787572238.308511:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787572238.308516:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787572238.309241:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787572238.309379:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787572238.320040:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787572238.320110:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787572238.320198:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787572238.320222:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787572238.320243:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320259:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320267:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320286:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320292:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320297:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320303:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b6713116 already unused, calling callback (000000000d76946a) 00010000:00010000:0.0:1787572238.320306:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320313:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320325:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320332:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572238.320337:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b6713116/0x9fe530ef4f435ff6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787572238.321789:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787572238.557900:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001df0900b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+5:5823:x1874405268390144:12345-0@lo:253: Request processed in 263221us (263430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572238.557941:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572238.558164:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c543b0e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390144:0@lo:253: 10000000:01000000:2.0:1787572238.558188:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787572238.558206:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787572238.558208:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787572238.558210:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572238.558211:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787572238.558212:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572238.558214:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572238.558215:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787572238.558217:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787572238.558219:0:5823:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787572238.558221:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572238.558222:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787572238.558247:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ee49a781 from lustre-MDT0000 10000000:01000000:2.0:1787572238.558283:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787572238.558287:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787572238.558292:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98d1d5ed4d28 10000000:01000000:2.0:1787572238.558298:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787572238.558307:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d1d5ed4d28 from 1 10000000:01000000:2.0:1787572238.558310:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787572238.558391:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000b842d5c8/0x9fe530ef4f435ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572238.558403:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000b842d5c8/0x9fe530ef4f435ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572238.558412:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000b842d5c8/0x9fe530ef4f435ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572238.558435:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f4b4a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390272:0@lo:101: 00000100:00100000:2.0:1787572238.558481:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572238.558540:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023290ae8 going to sleep for 11 seconds 00000100:00100000:1.0:1787572238.558673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268390272 00000100:00100000:1.0:1787572238.558683:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268390272 00000100:00100000:1.0:1787572238.558736:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787572238.558746:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c059889 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+5:5823:x1874405268390272:12345-0@lo:101: 00010000:00010000:1.0:1787572238.558761:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572238.558780:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe337758/0x9fe530ef4f436004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f435ffd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572238.558881:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe337758/0x9fe530ef4f436004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572238.558893:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe337758/0x9fe530ef4f436004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572238.558927:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe337758, rc 0) 00000100:00100000:1.0:1787572238.558987:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c059889 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+6:5823:x1874405268390272:12345-0@lo:101: Request processed in 243us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572238.558994:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787572238.559034:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f4b4a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390272:0@lo:101: 00010000:00010000:1.0:1787572238.559046:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000b842d5c8/0x9fe530ef4f435ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572238.559055:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000b842d5c8/0x9fe530ef4f435ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572238.559117:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b1738a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390400:0@lo:501: 00000100:00100000:1.0:1787572238.559144:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572238.559166:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e2390b4 going to sleep for 11 seconds 00000100:00100000:1.0:1787572238.559179:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268390400 00000100:00100000:1.0:1787572238.559183:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268390400 00000100:00100000:1.0:1787572238.559204:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572238.559210:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdf0a33f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+6:5823:x1874405268390400:12345-0@lo:501: 00000100:00100000:1.0:1787572238.559739:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdf0a33f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+6:5823:x1874405268390400:12345-0@lo:501: Request processed in 527us (593us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787572238.559747:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787572238.559960:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b1738a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390400:0@lo:501: 10000000:01000000:3.0:1787572238.559997:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787572238.560018:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 00000000b842d5c8/0x9fe530ef4f435ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572238.560027:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 00000000b842d5c8/0x9fe530ef4f435ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572238.560036:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d1c4a88000 10000000:01000000:3.0:1787572238.560041:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787572238.560054:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98d1c4a88000 10000000:01000000:3.0:1787572238.560057:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787572238.560060:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98d1c4a88000 from 1 10000000:01000000:3.0:1787572238.560062:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787572238.560104:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000dbac6ad5/0x9fe530ef4f43600b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572238.560111:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000dbac6ad5/0x9fe530ef4f43600b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572238.560119:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000dbac6ad5/0x9fe530ef4f43600b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572238.560133:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390528:0@lo:101: 00000100:00100000:3.0:1787572238.560166:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572238.560191:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b6fee7a going to sleep for 11 seconds 00000100:00100000:1.0:1787572238.560296:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268390528 00000100:00100000:1.0:1787572238.560301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268390528 00000100:00100000:1.0:1787572238.560388:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787572238.560397:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001206afe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+6:5823:x1874405268390528:12345-0@lo:101: 00010000:00010000:1.0:1787572238.560406:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572238.560425:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a155f2a2/0x9fe530ef4f436012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43600b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572238.560445:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a155f2a2/0x9fe530ef4f436012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43600b expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572238.560453:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a155f2a2/0x9fe530ef4f436012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43600b expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572238.560460:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a155f2a2, rc 0) 00000100:00100000:1.0:1787572238.560500:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001206afe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+7:5823:x1874405268390528:12345-0@lo:101: Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572238.560506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787572238.560569:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390528:0@lo:101: 00010000:00010000:3.0:1787572238.560580:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000dbac6ad5/0x9fe530ef4f43600b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572238.560588:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000dbac6ad5/0x9fe530ef4f43600b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572238.560602:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787572238.560610:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 00000000dbac6ad5/0x9fe530ef4f43600b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572238.560616:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 00000000dbac6ad5/0x9fe530ef4f43600b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572238.560632:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787572238.560665:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787572238.560670:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98d1c4a88000 10000000:01000000:3.0:1787572238.560673:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787572238.560676:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787572238.560678:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787572238.560694:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 0000000015ba2baa/0x9fe530ef4f436019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572238.560700:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 0000000015ba2baa/0x9fe530ef4f436019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572238.560707:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 0000000015ba2baa/0x9fe530ef4f436019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572238.560719:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390656:0@lo:101: 00000100:00100000:3.0:1787572238.560746:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572238.561058:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b6fee7a going to sleep for 11 seconds 00000100:00100000:2.0:1787572238.561127:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268390656 00000100:00100000:2.0:1787572238.561133:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268390656 00000100:00100000:2.0:1787572238.561158:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787572238.561164:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d00ee9ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+7:5823:x1874405268390656:12345-0@lo:101: 00010000:00010000:2.0:1787572238.561179:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572238.561190:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a322ec64/0x9fe530ef4f436020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436019 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572238.561206:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a322ec64/0x9fe530ef4f436020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572238.561214:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a322ec64/0x9fe530ef4f436020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572238.561220:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a322ec64, rc 0) 00000100:00100000:2.0:1787572238.561306:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d00ee9ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+8:5823:x1874405268390656:12345-0@lo:101: Request processed in 141us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572238.561313:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572238.561503:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390656:0@lo:101: 00010000:00010000:3.0:1787572238.561514:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 0000000015ba2baa/0x9fe530ef4f436019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572238.561522:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 0000000015ba2baa/0x9fe530ef4f436019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572238.561575:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390784:0@lo:501: 00000100:00100000:3.0:1787572238.561602:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572238.561696:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b6fee7a going to sleep for 11 seconds 00000100:00100000:2.0:1787572238.561773:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268390784 00000100:00100000:2.0:1787572238.561779:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268390784 00000100:00100000:2.0:1787572238.561933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787572238.561941:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040090a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+8:5823:x1874405268390784:12345-0@lo:501: 00000100:00100000:2.0:1787572238.562275:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040090a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+9:5823:x1874405268390784:12345-0@lo:501: Request processed in 335us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572238.562282:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787572238.562366:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390784:0@lo:501: 00000100:00100000:3.0:1787572238.562404:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390912:0@lo:503: 00000100:00100000:3.0:1787572238.562448:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572238.562611:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b6fee7a going to sleep for 11 seconds 00000100:00100000:1.0:1787572238.562736:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268390912 00000100:00100000:1.0:1787572238.562743:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268390912 00000100:00100000:1.0:1787572238.562767:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787572238.562773:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000213ce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+9:5823:x1874405268390912:12345-0@lo:503: 00000100:00100000:1.0:1787572238.563067:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000213ce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+9:5823:x1874405268390912:12345-0@lo:503: Request processed in 293us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572238.563076:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787572238.563180:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268390912:0@lo:503: 00000100:00100000:0.0:1787572238.564006:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee3890a pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:5865:1874405268391040:0@lo:502: 00000100:00100000:0.0:1787572238.564083:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572238.564125:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077cd6faa going to sleep for 11 seconds 00000100:00100000:1.0:1787572238.564188:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268391040 00000100:00100000:1.0:1787572238.564197:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268391040 00000100:00100000:1.0:1787572238.564249:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787572238.564260:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041a1e466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+9:5865:x1874405268391040:12345-0@lo:502: 00000100:00100000:1.0:1787572238.564673:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041a1e466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+9:5865:x1874405268391040:12345-0@lo:502: Request processed in 415us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572238.564681:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787572238.564779:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee3890a pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:5865:1874405268391040:0@lo:502: 00000020:01000000:0.0:1787572238.564897:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572238.564922:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572238.564925:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787572238.564930:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787572238.564933:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787572238.564951:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000069158444) 00000020:00000080:0.0:1787572238.564975:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787572238.564982:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787572238.565086:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787572238.565095:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f43602e 00000020:00000080:0.0:1787572238.565438:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787572238.565443:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572238.565447:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572238.565448:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787572238.565451:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572238.565455:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572238.565456:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787572238.565459:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787572238.565467:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000708dc39c) 00000020:00000080:0.0:1787572238.565477:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787572238.565481:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787572238.565483:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787572238.565486:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787572238.565492:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787572238.565543:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ee49a781 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787572238.565556:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000011a03547) 00000020:00000080:0.0:1787572238.565564:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787572238.565920:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787572238.566021:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f436043 00000020:00000080:1.0:1787572238.566184:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787572238.566198:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787572238.566204:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9fe530ef4f43604a 00080000:01000000:1.0:1787572238.566212:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787572238.566217:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f436051 00080000:10000000:1.0:1787572238.567021:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787572238.567258:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787572238.574700:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787572238.657892:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787572238.658774:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787572238.662699:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787572238.663132:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787572238.700295:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e6075a28) 00000020:00000080:3.0:1787572238.700330:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787572238.700429:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787572238.700438:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f43605f 00000020:00000080:1.0:1787572238.708807:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787572238.710401:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787572238.743312:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787572238.814095:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787572238.851923:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787572238.898728:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787572238.944686:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787572239.003023:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9fe530ef4f436066 00000020:00000080:1.0:1787572239.003507:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787572239.003522:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572239.003530:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572239.003533:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787572239.003537:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572239.003542:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572239.003543:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787572239.003546:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787572239.003548:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787572239.003551:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572239.003553:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572239.003554:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787572239.003556:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572239.003561:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572239.003562:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787572239.003566:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787572239.003606:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787572239.003712:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77fd962 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:5865:1874405268391168:0@lo:502: 00000100:00100000:1.0:1787572239.003912:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572239.003975:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d2379cf going to sleep for 11 seconds 00000100:00100000:2.0:1787572239.004085:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268391168 00000100:00100000:2.0:1787572239.004095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268391168 00000100:00100000:2.0:1787572239.004149:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787572239.004158:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7ede6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+9:5865:x1874405268391168:12345-0@lo:502: 00000100:00100000:1.0:1787572239.004878:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77fd962 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:5865:1874405268391168:0@lo:502: 00000020:01000000:1.0:1787572239.004933:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572239.004941:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572239.004943:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787572239.004950:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000100:00100000:2.0:1787572239.005192:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7ede6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+9:5865:x1874405268391168:12345-0@lo:502: Request processed in 1035us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572239.005204:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:3.0:1787572239.005424:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787572239.005453:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787572239.005519:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 0000000015ba2baa/0x9fe530ef4f436019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.005532:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 0000000015ba2baa/0x9fe530ef4f436019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572239.005542:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d1c4a88000 from 1 10000000:01000000:3.0:1787572239.005545:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787572239.005595:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.005602:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.005626:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572239.005692:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391296:0@lo:101: 00000100:00100000:3.0:1787572239.005748:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572239.005917:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf706d76 going to sleep for 11 seconds 00000100:00100000:1.0:1787572239.006017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268391296 00000100:00100000:1.0:1787572239.006025:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268391296 00000100:00100000:1.0:1787572239.006076:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787572239.006086:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf9fcf95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+9:5823:x1874405268391296:12345-0@lo:101: 00010000:00010000:1.0:1787572239.006102:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572239.006123:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43606d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.006154:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.006165:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.006174:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074b3ab08, rc 0) 00000100:00100000:1.0:1787572239.006219:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf9fcf95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+10:5823:x1874405268391296:12345-0@lo:101: Request processed in 135us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572239.006224:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787572239.006270:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de41d423 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391296:0@lo:101: 00010000:00010000:1.0:1787572239.006285:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.006305:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572239.007188:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77fd962 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391424:0@lo:256: 00000100:00100000:1.0:1787572239.007259:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572239.007526:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000006bb1ad51 going to sleep for 11 seconds 00000100:00100000:0.0:1787572239.007855:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268391424 00000100:00100000:0.0:1787572239.007865:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268391424 00000100:00100000:1.0:1787572239.008069:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787572239.008081:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cbc0aaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+10:5823:x1874405268391424:12345-0@lo:256: 20000000:01000000:1.0:1787572239.008110:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787572239.008117:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787572239.008223:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cbc0aaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+10:5823:x1874405268391424:12345-0@lo:256: Request processed in 144us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572239.008231:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787572239.008329:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77fd962 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391424:0@lo:256: 10000000:01000000:3.0:1787572239.009085:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787572239.009124:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.009137:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572239.009148:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1c4a88000 from 1 10000000:01000000:3.0:1787572239.009151:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787572239.009199:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.009207:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.009218:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572239.009241:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0313a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391552:0@lo:101: 00000100:00100000:3.0:1787572239.009302:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572239.016708:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a27cb6c5 going to sleep for 11 seconds 00000100:00100000:2.0:1787572239.017903:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268391552 00000100:00100000:2.0:1787572239.017920:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268391552 00000100:00100000:2.0:1787572239.018009:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787572239.018338:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e7e350 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+10:5823:x1874405268391552:12345-0@lo:101: 00010000:00010000:2.0:1787572239.018443:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572239.018475:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43607b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.018513:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.018524:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.018535:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005768d6cb, rc 0) 00000100:00100000:2.0:1787572239.018671:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e7e350 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5823:x1874405268391552:12345-0@lo:101: Request processed in 340us (9369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572239.018679:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787572239.018746:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0313a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391552:0@lo:101: 00010000:00010000:3.0:1787572239.018769:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.018780:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572239.018877:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0313a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391680:0@lo:501: 00000100:00100000:3.0:1787572239.018929:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572239.018972:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a27cb6c5 going to sleep for 11 seconds 00000100:00100000:1.0:1787572239.019494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268391680 00000100:00100000:1.0:1787572239.019504:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268391680 00000100:00100000:1.0:1787572239.019560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787572239.019569:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e4f8a06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5823:x1874405268391680:12345-0@lo:501: 00000100:00100000:1.0:1787572239.021261:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e4f8a06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5823:x1874405268391680:12345-0@lo:501: Request processed in 1685us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572239.021421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572239.021500:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0313a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391680:0@lo:501: 00000100:00100000:2.0:1787572239.021570:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391808:0@lo:503: 00000100:00100000:2.0:1787572239.021630:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572239.021686:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a29ec76 going to sleep for 11 seconds 00000100:00100000:1.0:1787572239.021801:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268391808 00000100:00100000:1.0:1787572239.021810:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268391808 00000100:00100000:1.0:1787572239.021861:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787572239.021870:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f3d53ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5823:x1874405268391808:12345-0@lo:503: 00000040:00080000:1.0:1787572239.021932:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787572239.021988:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f3d53ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5823:x1874405268391808:12345-0@lo:503: Request processed in 119us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572239.022000:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787572239.022476:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391808:0@lo:503: 00000040:00080000:2.0:1787572239.027429:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787572239.027885:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787572239.027923:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787572239.027947:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.027963:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572239.028032:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787572239.028035:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d1c4a88000 10000000:01000000:3.0:1787572239.028038:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d1c4a88000 10000000:01000000:3.0:1787572239.028042:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787572239.028050:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1c4a88000 from 1 10000000:01000000:3.0:1787572239.028053:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787572239.028102:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000612a1a95/0x9fe530ef4f436089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.028110:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000612a1a95/0x9fe530ef4f436089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572239.028146:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000612a1a95/0x9fe530ef4f436089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572239.028175:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b063d4c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391936:0@lo:101: 00000100:00100000:3.0:1787572239.028259:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572239.028331:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf706d76 going to sleep for 11 seconds 00000100:00100000:1.0:1787572239.028385:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268391936 00000100:00100000:1.0:1787572239.028396:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268391936 00000100:00100000:1.0:1787572239.028465:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787572239.028476:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fb54160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5823:x1874405268391936:12345-0@lo:101: 00010000:00010000:1.0:1787572239.028493:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572239.028509:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3a20deb/0x9fe530ef4f436090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436089 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.028536:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3a20deb/0x9fe530ef4f436090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.028549:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3a20deb/0x9fe530ef4f436090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.028560:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3a20deb, rc 0) 00000100:00100000:1.0:1787572239.028616:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fb54160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5823:x1874405268391936:12345-0@lo:101: Request processed in 143us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572239.028624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787572239.028674:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b063d4c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268391936:0@lo:101: 00010000:00010000:2.0:1787572239.028691:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000612a1a95/0x9fe530ef4f436089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.028718:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000612a1a95/0x9fe530ef4f436089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572239.028781:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268392064:0@lo:501: 00000100:00100000:2.0:1787572239.028811:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572239.028841:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d96e11d6 going to sleep for 11 seconds 00000100:00100000:1.0:1787572239.028891:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268392064 00000100:00100000:1.0:1787572239.028906:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268392064 00000100:00100000:1.0:1787572239.028936:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787572239.028942:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ec322e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5823:x1874405268392064:12345-0@lo:501: 00000100:00100000:1.0:1787572239.029290:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ec322e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5823:x1874405268392064:12345-0@lo:501: Request processed in 347us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572239.029297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787572239.029442:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268392064:0@lo:501: 00000100:00100000:2.0:1787572239.029476:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268392192:0@lo:503: 00000100:00100000:2.0:1787572239.029516:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572239.029538:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d96e11d6 going to sleep for 11 seconds 00000100:00100000:3.0:1787572239.029683:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268392192 00000100:00100000:3.0:1787572239.029688:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268392192 00000100:00100000:3.0:1787572239.029719:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787572239.029727:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddaec228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5823:x1874405268392192:12345-0@lo:503: 00000100:00100000:3.0:1787572239.030226:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddaec228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5823:x1874405268392192:12345-0@lo:503: Request processed in 499us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572239.030234:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787572239.030449:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268392192:0@lo:503: 00000100:00100000:0.0:1787572239.031781:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee3890a pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:5870:1874405268392320:0@lo:502: 00000100:00100000:0.0:1787572239.031880:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572239.031943:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e65bd1a5 going to sleep for 11 seconds 00000100:00100000:3.0:1787572239.031948:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268392320 00000100:00100000:3.0:1787572239.031958:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268392320 00000100:00100000:3.0:1787572239.032046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787572239.032057:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050f151f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5870:x1874405268392320:12345-0@lo:502: 00000100:00100000:3.0:1787572239.032437:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050f151f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5870:x1874405268392320:12345-0@lo:502: Request processed in 381us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572239.032446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787572239.032537:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee3890a pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:5870:1874405268392320:0@lo:502: 00000020:01000004:0.0:1787572239.032612:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787572239.032673:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ee80a1fe) 00000020:00000080:0.0:1787572239.032702:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787572239.032796:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ee49a781 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787572239.032800:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ee49a781 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787572239.032803:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ee49a781 4 00010000:00080000:0.0:1787572239.032836:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000032a820f7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:0.0:1787572239.034632:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787572239.034941:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787572239.034983:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787572239.035000:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9fe530ef4f43609e 00000100:00080000:0.0:1787572239.035014:0:5870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787572239.035019:0:5870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000032a820f7 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1787572239.035070:0:5870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cee3890a x1874405268392448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787572239.035132:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee3890a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268392448:0@lo:38: 00000100:00100000:0.0:1787572239.035219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572239.035296:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268392448 00000100:00100000:0.0:1787572239.035304:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268392448 00000100:00100000:0.0:1787572239.035342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787572239.035350:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068123ea4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874405268392448:12345-0@lo:38: 00000100:00100000:0.0:1787572239.037359:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068123ea4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874405268392448:12345-0@lo:38: Request processed in 1998us (2130us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787572239.037378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787572239.037484:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787572239.037495:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000032a820f7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787572239.037514:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787572239.037518:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee3890a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268392448:0@lo:38: 00000100:00080000:0.0:1787572239.037572:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787572239.039125:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:5870:1874405268392576:0@lo:502: 00000100:00100000:2.0:1787572239.039224:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572239.039270:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e2df0eb going to sleep for 11 seconds 00000100:00100000:1.0:1787572239.039326:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268392576 00000100:00100000:1.0:1787572239.039337:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268392576 00000100:00100000:1.0:1787572239.039414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787572239.039424:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dfa3df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5870:x1874405268392576:12345-0@lo:502: 00000100:00100000:1.0:1787572239.039955:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dfa3df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5870:x1874405268392576:12345-0@lo:502: Request processed in 527us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572239.039964:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787572239.040193:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:5870:1874405268392576:0@lo:502: 00000040:00080000:2.0:1787572239.040234:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787572239.040418:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787572239.040445:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787572239.040466:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 00000000612a1a95/0x9fe530ef4f436089 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.040478:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 00000000612a1a95/0x9fe530ef4f436089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787572239.040537:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787572239.040540:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787572239.040542:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572239.040543:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572239.040545:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572239.040547:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572239.040548:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787572239.040550:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787572239.040552:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787572239.040554:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787572239.040555:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572239.040557:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787572239.040563:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787572239.040566:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787572239.040568:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787572239.040569:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572239.040571:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572239.040572:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572239.040573:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572239.040574:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787572239.040575:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787572239.040576:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787572239.040582:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787572239.040583:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572239.040584:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787572239.040610:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787572239.040626:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b3d4567 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268392704:0@lo:253: 00000100:00100000:1.0:1787572239.040695:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572239.040727:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f945d2f going to sleep for 11 seconds 00000100:00100000:1.0:1787572239.040753:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268392704 00000100:00100000:1.0:1787572239.041027:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268392704 00000100:00100000:1.0:1787572239.041112:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787572239.041124:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008186c7d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5823:x1874405268392704:12345-0@lo:253: 20000000:01000000:1.0:1787572239.041176:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787572239.041198:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787572239.086126:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787572239.086194:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787572239.086455:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787572239.086462:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787572239.086493:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.086523:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.086531:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.086592:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.086610:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 12 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572239.086628:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004fcdc9c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874405268392832:0@lo:104: 00000100:00100000:1.0:1787572239.086835:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572239.086992:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016aa3ba4 going to sleep for 11 seconds 00000100:00100000:2.0:1787572239.087103:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268392832 00000100:00100000:2.0:1787572239.087116:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268392832 00000100:00100000:2.0:1787572239.087185:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572239.087196:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c817e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5858:x1874405268392832:12345-0@lo:104: 00010000:00010000:2.0:1787572239.087213:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.087298:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787572239.087305:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c817e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5858:x1874405268392832:12345-0@lo:104: Request processed in 110us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572239.087313:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787572239.087627:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004fcdc9c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874405268392832:0@lo:104: 00010000:00010000:1.0:1787572239.087683:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572239.090078:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572239.090093:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572239.090109:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b99ba55d already unused, calling callback (00000000373815fe) 10000000:00010000:0.0:1787572239.090113:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572239.090125:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572239.090132:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572239.090137:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787572239.090305:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572239.090313:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787572239.090671:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee3890a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268392960:0@lo:103: 00000100:00100000:3.0:1787572239.090838:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787572239.090995:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572239.091004:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: 00000000b99ba55d/0x9fe530ef4f43606d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436074 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572239.091054:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572239.091056:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572239.091059:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572239.091339:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268392960 00000100:00100000:2.0:1787572239.091360:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268392960 00010000:00010000:2.0:1787572239.091409:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 13 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572239.091451:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572239.091460:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003df9beaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3311:x1874405268392960:12345-0@lo:103: 00010000:00010000:2.0:1787572239.091477:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572239.091482:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 13 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091496:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 13 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091513:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074b3ab08/0x9fe530ef4f436074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43606d expref: 13 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091533:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091542:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787572239.091561:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005101004s 00010000:00010000:2.0:1787572239.091567:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091582:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091590:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091596:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091602:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db310a3a already unused, calling callback (000000000d76946a) 00010000:00010000:2.0:1787572239.091606:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091613:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091626:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572239.091670:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572239.091718:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003df9beaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:3311:x1874405268392960:12345-0@lo:103: Request processed in 260us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572239.091725:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572239.091975:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee3890a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268392960:0@lo:103: 00010000:00010000:1.0:1787572239.093077:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.093094:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572239.093100:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db310a3a/0x9fe530ef4f4360a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572239.108432:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008186c7d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5823:x1874405268392704:12345-0@lo:253: Request processed in 67295us (67721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572239.108454:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787572239.108568:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b3d4567 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:5823:1874405268392704:0@lo:253: 10000000:01000000:3.0:1787572239.108590:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787572239.108613:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787572239.108615:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787572239.108617:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787572239.108618:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787572239.108619:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787572239.108620:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787572239.108621:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787572239.108623:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787572239.108625:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787572239.108626:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787572239.108628:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787572239.108630:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787572239.108677:0:5823:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787572239.117252:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572239.118549:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572239.119437:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572239.119916:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572239.120222:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572239.120538:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572239.121877:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572239.122116:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572239.122478:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572239.123064:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572239.123457:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572239.123966:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:1.0:1787572239.151622:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1787572239.189604:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787572239.237372:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787572239.237676:0:5875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787572239.237683:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787572239.237851:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787572239.258690:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787572239.263881:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787572239.266291:0:5823:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787572239.266319:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787572239.267178:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787572239.268182:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787572239.270035:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787572239.272351:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787572239.272804:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787572239.273040:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787572239.277323:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787572239.277693:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787572239.278003:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787572239.278483:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787572239.278623:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787572239.279077:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787572239.279770:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787572239.279983:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787572239.280176:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787572239.280423:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787572239.280838:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787572239.281004:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787572239.281224:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787572239.281951:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787572239.282180:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787572239.282483:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787572239.282990:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787572239.283944:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787572239.284396:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787572239.284632:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787572239.284864:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787572239.285037:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787572239.285445:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787572239.285619:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787572239.285831:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787572239.286019:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787572239.286438:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787572239.286598:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787572239.286867:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787572239.287049:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787572239.287566:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787572239.287826:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787572239.288088:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787572239.350371:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787572239.406487:0:5823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787572239.406547:0:5823:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa61841c63988 00100000:10000000:0.0:1787572239.406557:0:5823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787572239.411578:0:5823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787572239.411613:0:5823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787572239.411661:0:5823:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787572239.411685:0:5823:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787572239.486775:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787572239.486856:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787572239.486861:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787572240.175843:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572241.198808:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572242.230555:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572243.251483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787572244.113203:0:6119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787572244.272106:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572244.474588:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268393088:0@lo:400: 00000100:00100000:3.0:1787572244.474696:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572244.474814:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268393088 00000100:00100000:1.0:1787572244.474824:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268393088 00000100:00100000:1.0:1787572244.474873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787572244.474882:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000982d3039 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:3312:x1874405268393088:12345-0@lo:400: 00000100:00080000:2.0:1787572244.474966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787572244.474983:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787572244.474986:0:36:0:(import.c:65:import_set_state_nolock()) 0000000032a820f7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787572244.474993:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000032a820f7 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1787572244.475017:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b4a5fd74 x1874405268393216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787572244.475069:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4a5fd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268393216:0@lo:38: 00000100:00100000:2.0:1787572244.475130:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572244.477401:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268393216 00000100:00100000:0.0:1787572244.477417:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268393216 00000100:00100000:0.0:1787572244.477449:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787572244.477456:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f6a0b1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874405268393216:12345-0@lo:38: 00010000:00080000:0.0:1787572244.477486:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:0.0:1787572244.477525:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9fe530ef4f4360ac 00000004:00100000:0.0:1787572244.478005:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787572244.478139:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000ecb7084f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787572244.478229:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f6a0b1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874405268393216:12345-0@lo:38: Request processed in 773us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572244.478294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787572244.478728:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b4a5fd74 x1874405268393216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787572254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787572244.478748:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787572244.480841:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787572244.480866:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787572244.480870:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000032a820f7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787572244.480883:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4a5fd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268393216:0@lo:38: 00000100:00100000:1.0:1787572244.483816:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000982d3039 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:3312:x1874405268393088:12345-0@lo:400: Request processed in 8926us (9112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572244.483843:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787572244.484453:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7205ce6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268393088:0@lo:400: 00010000:00010000:1.0:1787572245.295496:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572246.318915:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787572246.511188:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787572246.511200:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d1c4a88000 from 3 10000000:01000000:1.0:1787572246.511206:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787572246.511327:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 000000009b342e19/0x9fe530ef4f4360b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572246.511342:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 000000009b342e19/0x9fe530ef4f4360b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572246.511354:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 000000009b342e19/0x9fe530ef4f4360b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572246.511398:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004fcdc9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268393344:0@lo:101: 00000100:00100000:1.0:1787572246.511529:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572246.511658:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094e8c1e0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572246.512738:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268393344 00000100:00100000:2.0:1787572246.512760:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268393344 00000100:00100000:2.0:1787572246.512833:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787572246.512842:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2cb7b41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5839:x1874405268393344:12345-0@lo:101: 00010000:00010000:2.0:1787572246.512860:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572246.512876:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b31cf9a/0x9fe530ef4f4360ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4360b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572246.512904:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b31cf9a/0x9fe530ef4f4360ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572246.512914:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b31cf9a/0x9fe530ef4f4360ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572246.512924:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b31cf9a, rc 0) 00000100:00100000:2.0:1787572246.512994:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2cb7b41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268393344:12345-0@lo:101: Request processed in 153us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572246.513001:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787572246.513403:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004fcdc9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268393344:0@lo:101: 00010000:00010000:1.0:1787572246.513421:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 000000009b342e19/0x9fe530ef4f4360b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572246.513430:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 000000009b342e19/0x9fe530ef4f4360b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572246.513533:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004fcdc9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268393472:0@lo:256: 00000100:00100000:1.0:1787572246.513573:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572246.513623:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094e8c1e0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572246.513695:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268393472 00000100:00100000:3.0:1787572246.513701:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268393472 00000100:00100000:3.0:1787572246.513740:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787572246.513747:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b446e454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268393472:12345-0@lo:256: 20000000:01000000:3.0:1787572246.513773:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787572246.513790:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787572246.513793:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787572246.513880:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b446e454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268393472:12345-0@lo:256: Request processed in 134us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572246.513888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787572246.515062:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004fcdc9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268393472:0@lo:256: 10000000:01000000:1.0:1787572246.515167:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787572246.515176:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 000000009b342e19/0x9fe530ef4f4360b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572246.515186:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 000000009b342e19/0x9fe530ef4f4360b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572247.342792:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572248.366885:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787572248.766384:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec7c44730 20000000:00000080:0.0:1787572248.766405:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d1ee3ca000 uarg=0000000000000000 20000000:01000000:0.0:1787572248.766445:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787572248.766452:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787572248.766457:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787572248.767320:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787572248.767336:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787572248.773424:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787572248.773988:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787572248.774052:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787572248.774121:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787572248.774139:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787572248.774420:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.774441:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.774448:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.774503:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.774519:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 11 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572248.774534:0:6320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa58549a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1874405268393600:0@lo:104: 00000100:00100000:0.0:1787572248.774607:0:6320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572248.774724:0:6320:0:(client.c:2715:ptlrpc_set_wait()) set 000000008eefb2f1 going to sleep for 11 seconds 00000100:00100000:2.0:1787572248.774900:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268393600 00000100:00100000:2.0:1787572248.774910:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268393600 00000100:00100000:2.0:1787572248.774969:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572248.774980:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009af9ec61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:6320:x1874405268393600:12345-0@lo:104: 00010000:00010000:2.0:1787572248.774997:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.775070:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787572248.775076:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009af9ec61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:6320:x1874405268393600:12345-0@lo:104: Request processed in 99us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572248.775083:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787572248.775332:0:6320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa58549a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1874405268393600:0@lo:104: 00010000:00010000:0.0:1787572248.775352:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.775698:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572248.775704:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.775729:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c292ee49 already unused, calling callback (00000000373815fe) 10000000:00010000:0.0:1787572248.775732:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.775740:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572248.775746:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572248.775751:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787572248.775789:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.775795:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572248.775817:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.775822:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: 00000000c292ee49/0x9fe530ef4f43607b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.775841:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572248.775843:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572248.775844:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572248.775856:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa58549a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268393728:0@lo:103: 00000100:00100000:0.0:1787572248.775892:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572248.776217:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268393728 00000100:00100000:2.0:1787572248.776223:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268393728 00010000:00010000:2.0:1787572248.776249:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 12 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572248.776323:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572248.776331:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002002a2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:3313:x1874405268393728:12345-0@lo:103: 00010000:00010000:2.0:1787572248.776345:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572248.776351:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 12 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776362:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 12 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776375:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005768d6cb/0x9fe530ef4f436082 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43607b expref: 12 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776389:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776396:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776409:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776415:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776421:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776439:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776444:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000058529015 already unused, calling callback (000000000d76946a) 00010000:00010000:2.0:1787572248.776447:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776453:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776481:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572248.776491:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572248.776528:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002002a2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:3313:x1874405268393728:12345-0@lo:103: Request processed in 199us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572248.776535:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787572248.776682:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa58549a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268393728:0@lo:103: 00010000:00010000:0.0:1787572248.776966:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.776985:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572248.776991:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000058529015/0x9fe530ef4f4360c1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572249.390819:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572249.583192:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032c28282 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268393984:0@lo:400: 00000100:00100000:1.0:1787572249.583276:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572249.583364:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572249.583370:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022dc9f77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268393856:0@lo:400: 00000100:00100000:1.0:1787572249.583401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572249.583600:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268393984 00000100:00100000:2.0:1787572249.583610:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268393984 00000100:00100000:2.0:1787572249.583700:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572249.583711:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004fcdc9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268393984:12345-0@lo:400: 00000100:00100000:2.0:1787572249.583767:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004fcdc9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268393984:12345-0@lo:400: Request processed in 59us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572249.583775:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787572249.583923:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000032c28282 x1874405268393984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572249.583938:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032c28282 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268393984:0@lo:400: 00000100:00100000:3.0:1787572249.584104:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268393856 00000100:00100000:3.0:1787572249.584109:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268393856 00000100:00100000:3.0:1787572249.584157:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787572249.584164:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e46c1195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:3311:x1874405268393856:12345-0@lo:400: 00000100:00100000:3.0:1787572249.584210:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e46c1195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:3311:x1874405268393856:12345-0@lo:400: Request processed in 48us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572249.584217:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787572249.584340:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022dc9f77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268393856:0@lo:400: 00010000:00010000:0.0:1787572250.416900:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572251.440876:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572252.463530:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572253.489041:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787572254.190918:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787572254.190927:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1c4a88000 from 1 10000000:01000000:1.0:1787572254.190934:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787572254.190986:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000b09c6427/0x9fe530ef4f4360c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572254.191001:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000b09c6427/0x9fe530ef4f4360c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572254.191011:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000b09c6427/0x9fe530ef4f4360c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572254.191046:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3a354c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268394112:0@lo:101: 00000100:00100000:1.0:1787572254.191611:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572254.191738:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000000586fe77 going to sleep for 11 seconds 00000100:00100000:3.0:1787572254.191796:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268394112 00000100:00100000:3.0:1787572254.191805:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268394112 00000100:00100000:3.0:1787572254.191942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787572254.191961:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000367cda4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:5839:x1874405268394112:12345-0@lo:101: 00010000:00010000:3.0:1787572254.191978:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572254.191995:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf35fc7a/0x9fe530ef4f4360cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4360c8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572254.192019:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf35fc7a/0x9fe530ef4f4360cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572254.192028:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf35fc7a/0x9fe530ef4f4360cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572254.192037:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf35fc7a, rc 0) 00000100:00100000:3.0:1787572254.192328:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000367cda4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268394112:12345-0@lo:101: Request processed in 368us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572254.192581:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3a354c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268394112:0@lo:101: 00010000:00010000:1.0:1787572254.192597:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000b09c6427/0x9fe530ef4f4360c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572254.192615:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000b09c6427/0x9fe530ef4f4360c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572254.192695:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3a354c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268394240:0@lo:501: 00000100:00100000:1.0:1787572254.192726:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572254.192753:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000000586fe77 going to sleep for 11 seconds 00000100:00100000:1.0:1787572254.192768:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268394240 00000100:00100000:1.0:1787572254.192772:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268394240 00000100:00100000:3.0:1787572254.193592:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787572254.193928:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787572254.193939:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081982bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268394240:12345-0@lo:501: 00000100:00100000:1.0:1787572254.194943:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081982bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268394240:12345-0@lo:501: Request processed in 1003us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572254.194952:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787572254.195104:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3a354c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268394240:0@lo:501: 00000100:00100000:0.0:1787572254.195157:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bae05782 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268394368:0@lo:503: 00000100:00100000:0.0:1787572254.195203:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572254.195791:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d768b72 going to sleep for 11 seconds 00000100:00100000:1.0:1787572254.195875:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268394368 00000100:00100000:1.0:1787572254.195882:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268394368 00000100:00100000:1.0:1787572254.195923:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787572254.195931:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092c70333 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268394368:12345-0@lo:503: 00000100:00100000:1.0:1787572254.196701:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092c70333 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268394368:12345-0@lo:503: Request processed in 769us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572254.196719:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787572254.196871:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bae05782 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268394368:0@lo:503: 00000100:00100000:3.0:1787572254.197775:0:6637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015323497 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:6637:1874405268394496:0@lo:502: 00000100:00100000:3.0:1787572254.197823:0:6637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572254.197883:0:6637:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013e2b837 going to sleep for 11 seconds 00000100:00100000:1.0:1787572254.197913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268394496 00000100:00100000:1.0:1787572254.197920:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268394496 00000100:00100000:1.0:1787572254.197976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787572254.197984:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed5760d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6637:x1874405268394496:12345-0@lo:502: 00000100:00100000:1.0:1787572254.198290:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed5760d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6637:x1874405268394496:12345-0@lo:502: Request processed in 307us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572254.198298:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787572254.198475:0:6637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015323497 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:6637:1874405268394496:0@lo:502: 00000020:01000000:0.0:1787572254.198498:0:6637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572254.198506:0:6637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572254.198509:0:6637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787572254.198515:0:6637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d1c4a88000 00000020:00000080:0.0:1787572254.198517:0:6637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787572254.198550:0:6637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:6637:1874405268394624:0@lo:502: 00000100:00100000:0.0:1787572254.198582:0:6637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572254.198979:0:6637:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d07e1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787572254.199020:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268394624 00000100:00100000:3.0:1787572254.199026:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268394624 00000100:00100000:3.0:1787572254.199079:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787572254.199087:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6637:x1874405268394624:12345-0@lo:502: 00000100:00100000:3.0:1787572254.199258:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6637:x1874405268394624:12345-0@lo:502: Request processed in 171us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572254.199265:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787572254.199790:0:6637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:6637:1874405268394624:0@lo:502: 00000020:01000000:0.0:1787572254.199837:0:6637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572254.199844:0:6637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572254.199846:0:6637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787572254.199850:0:6637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787572254.200679:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787572254.200705:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787572254.200718:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572254.200742:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572254.511882:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572254.705621:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268394752:0@lo:400: 00000100:00100000:2.0:1787572254.705732:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572254.705991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268394752 00000100:00100000:0.0:1787572254.705998:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268394752 00000100:00100000:0.0:1787572254.706057:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787572254.706067:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268394752:12345-0@lo:400: 00000100:00100000:0.0:1787572254.706187:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268394752:12345-0@lo:400: Request processed in 122us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572254.706196:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787572254.706396:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d1f3814380 x1874405268394752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572254.706432:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268394752:0@lo:400: 00010000:00010000:2.0:1787572255.537044:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787572255.820239:0:6688:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787572255.820244:0:6688:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787572255.820377:0:6688:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d1cebea800 00000020:01000004:0.0:1787572255.820392:0:6688:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787572255.820404:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787572255.820417:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98d1f3c6b370) 00000020:00000080:0.0:1787572255.820442:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787572255.846421:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787572255.846757:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787572255.869601:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787572255.877831:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787572255.877865:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787572255.877923:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787572255.877952:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787572255.879367:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787572255.879378:0:6688:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787572255.879389:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9fe530ef4f4360dd 00000020:01000004:2.0:1787572255.879398:0:6688:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787572255.879420:0:6688:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787572255.879423:0:6688:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787572255.879429:0:6688:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787572255.879433:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787572255.879446:0:6688:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98d1de1ccd28) 00000020:00000080:2.0:1787572255.879456:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787572255.884903:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787572255.885103:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787572255.885110:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787572255.888377:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787572255.888390:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787572255.893176:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787572255.893190:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787572255.895260:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787572255.895445:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787572255.895452:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787572255.898551:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787572255.898562:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787572255.937122:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787572255.937365:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787572255.937371:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787572255.946123:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787572255.946163:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787572255.951224:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787572255.951240:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787572255.955376:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787572255.956234:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787572255.956241:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787572255.957184:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787572255.957193:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787572256.034469:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787572256.034933:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787572256.034941:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787572256.036381:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787572256.036392:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787572256.037172:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787572256.037200:0:6688:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787572256.037206:0:6688:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787572256.080385:0:6688:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787572256.080422:0:6688:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.155@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787572256.080426:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787572256.080428:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787572256.080429:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572256.080430:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572256.080431:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572256.080432:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572256.080434:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572256.080435:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787572256.080436:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787572256.080437:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572256.080438:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787572256.080442:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787572256.080443:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787572256.080445:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787572256.080446:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572256.080446:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572256.080448:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572256.080448:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572256.080449:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572256.080450:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787572256.080451:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787572256.080452:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572256.080453:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787572256.080481:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787572256.080578:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268394880:0@lo:253: 00000100:00100000:2.0:1787572256.080683:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572256.080829:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b31c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572256.081576:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268394880 00000100:00100000:3.0:1787572256.081585:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268394880 00000100:00100000:3.0:1787572256.081743:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787572256.081754:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268394880:12345-0@lo:253: 20000000:01000000:3.0:1787572256.081788:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787572256.081793:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787572256.081822:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787572256.081829:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787572256.083586:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787572256.083894:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787572256.083909:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787572256.083951:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787572256.083960:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787572256.083991:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787572256.084583:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787572256.089250:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787572256.089285:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.155@tcp 20000000:01000000:3.0:1787572256.089309:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:3.0:1787572256.089419:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787572256.089428:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787572256.089576:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787572256.089588:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:3.0:1787572256.089724:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787572256.089736:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787572256.089778:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787572256.089834:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787572256.091237:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787572256.091264:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.155@tcp 20000000:01000000:3.0:1787572256.091266:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:3.0:1787572256.091300:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787572256.091308:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787572256.091352:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787572256.091360:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:3.0:1787572256.091407:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787572256.091417:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787572256.091451:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787572256.091513:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787572256.091531:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787572256.091535:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787572256.091542:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787572256.091544:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787572256.091546:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787572256.091559:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787572256.091562:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787572256.091608:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787572256.091610:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787572256.096331:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787572256.096823:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787572256.096874:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787572256.096948:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787572256.096970:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787572256.096973:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787572256.098288:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787572256.098436:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787572256.098488:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787572256.099472:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787572256.099615:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787572256.099744:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787572256.099758:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787572256.099760:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787572256.108145:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787572256.108242:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787572256.108300:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787572256.108800:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787572256.108865:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787572256.108915:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:3.0:1787572256.108931:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787572256.108950:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.108969:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.108976:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d206279000/0x9fe530ef4f436020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.108982:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.108988:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.109115:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.109128:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 12 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572256.109143:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874405268395008:0@lo:104: 00000100:00100000:3.0:1787572256.109213:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787572256.109269:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d206279000/0x9fe530ef4f436020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.109278:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d206279000/0x9fe530ef4f436020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 12 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572256.109285:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874405268395136:0@lo:104: 00000100:00100000:3.0:1787572256.109305:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787572256.109595:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.109603:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 12 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572256.109611:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874405268395264:0@lo:104: 00000100:00100000:3.0:1787572256.109630:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.109983:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572256.110620:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268395008 00000100:00100000:2.0:1787572256.110629:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268395008 00000100:00100000:3.0:1787572256.110959:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268395136 00000100:00100000:3.0:1787572256.110963:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268395136 00000100:00100000:3.0:1787572256.110975:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268395264 00000100:00100000:3.0:1787572256.110978:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268395264 00000100:00100000:3.0:1787572256.111080:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787572256.111091:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+5:5836:x1874405268395008:12345-0@lo:104: 00010000:00010000:3.0:1787572256.111106:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111224:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787572256.111231:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+5:5836:x1874405268395008:12345-0@lo:104: Request processed in 143us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.111247:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787572256.111267:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787572256.111273:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+4:5836:x1874405268395136:12345-0@lo:104: 00010000:00010000:3.0:1787572256.111282:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f436019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111319:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787572256.111336:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+4:5836:x1874405268395136:12345-0@lo:104: Request processed in 64us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.111343:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787572256.111355:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787572256.111361:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5836:x1874405268395264:12345-0@lo:104: 00010000:00010000:3.0:1787572256.111368:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d206279a00/0x9fe530ef4f435ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111396:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787572256.111401:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5836:x1874405268395264:12345-0@lo:104: Request processed in 41us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.111406:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787572256.111422:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787572256.111427:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111434:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463400 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:3.0:1787572256.111439:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111459:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787572256.111467:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572256.111473:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787572256.111708:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111715:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787572256.111736:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436089 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111743:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436090 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111757:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787572256.111760:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f436019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111766:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462000 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:3.0:1787572256.111769:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f436019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111776:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f436019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787572256.111782:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f436019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572256.111794:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787572256.111809:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f436019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111815:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787572256.111829:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f436019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111836:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f436019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436020 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111926:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572256.111930:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d206279a00/0x9fe530ef4f435ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111936:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d206279a00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:3.0:1787572256.111939:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d206279a00/0x9fe530ef4f435ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111945:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d206279a00/0x9fe530ef4f435ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787572256.111950:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d206279a00/0x9fe530ef4f435ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572256.111955:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787572256.111967:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d206279a00/0x9fe530ef4f435ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111973:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787572256.111985:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d206279a00/0x9fe530ef4f435ffd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.111991:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d206279a00/0x9fe530ef4f435ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436004 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.112004:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572256.112006:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572256.112008:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572256.112102:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268395392:0@lo:103: 00000100:00100000:3.0:1787572256.112140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.112176:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268395520:0@lo:103: 00000100:00100000:3.0:1787572256.112197:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.112214:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572256.112219:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268395648:0@lo:103: 00000100:00100000:3.0:1787572256.112237:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.112272:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268395392 00000100:00100000:3.0:1787572256.112279:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268395392 00010000:00010000:3.0:1787572256.112301:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436090 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 13 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572256.112317:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268395520 00010000:00010000:2.0:1787572256.112423:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572256.112656:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268395648 00000100:00100000:2.0:1787572256.112660:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268395648 00010000:00010000:2.0:1787572256.112678:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436004 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 14 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572256.112705:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572256.112712:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:3313:x1874405268395392:12345-0@lo:103: 00010000:00010000:2.0:1787572256.112723:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572256.112727:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436090 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 14 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.112737:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 14 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.112753:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572256.112787:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:3313:x1874405268395392:12345-0@lo:103: Request processed in 75us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.112793:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572256.112806:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787572256.112812:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3310:x1874405268395648:12345-0@lo:103: 00010000:00010000:2.0:1787572256.112818:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572256.112822:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436004 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 13 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.112830:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 13 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.112839:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572256.112951:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3310:x1874405268395648:12345-0@lo:103: Request processed in 139us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.112957:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787572256.122172:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268395520 00010000:00010000:3.0:1787572256.122229:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d206279000/0x9fe530ef4f436020 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 13 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572256.122626:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787572256.122658:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3310:x1874405268395520:12345-0@lo:103: 00010000:00010000:3.0:1787572256.122676:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572256.122698:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d206279000/0x9fe530ef4f436020 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 13 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122713:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d206279000/0x9fe530ef4f436020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 13 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122735:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122744:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122761:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122769:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122777:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122784:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122791:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572256.122795:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122803:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122812:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.122833:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572256.122907:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3310:x1874405268395520:12345-0@lo:103: Request processed in 271us (10708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.122915:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787572256.124082:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436089 expref: 12 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572256.124102:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874405268395008:0@lo:104: 00010000:00010000:0.0:1787572256.124136:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206279000/0x9fe530ef4f436020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436019 expref: 11 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572256.124149:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874405268395136:0@lo:104: 00010000:00010000:0.0:1787572256.124160:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f435ffd expref: 10 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572256.124168:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874405268395264:0@lo:104: 00010000:00010000:0.0:1787572256.124191:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.124200:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.124206:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.124212:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c1462c00/0x9fe530ef4f4360eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787572256.124228:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787572256.133196:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268395392:0@lo:103: 00000100:00100000:1.0:1787572256.134127:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268395648:0@lo:103: 00000100:00100000:1.0:1787572256.134140:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268395520:0@lo:103: 00000100:00100000:3.0:1787572256.219079:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+9:6688:x1874405268394880:12345-0@lo:253: Request processed in 137316us (138385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.219094:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787572256.219251:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268394880:0@lo:253: 10000000:01000000:0.0:1787572256.219266:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787572256.219280:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787572256.219282:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787572256.219283:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572256.219285:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787572256.219286:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572256.219287:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572256.219289:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787572256.219291:0:6688:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787572256.219292:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572256.219294:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787572256.219312:0:6688:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d1cebea800 from lustre-OST0000 10000000:01000000:0.0:1787572256.219338:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787572256.219340:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787572256.219348:0:6688:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98d1d5ed4d28 local copy 10000000:01000000:0.0:1787572256.219352:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787572256.219387:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.219398:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.219409:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572256.219426:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268395776:0@lo:101: 00000100:00100000:0.0:1787572256.219462:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572256.219519:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b31c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572256.219630:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268395776 00000100:00100000:3.0:1787572256.219665:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268395776 00000100:00100000:3.0:1787572256.219702:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787572256.219711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+9:6688:x1874405268395776:12345-0@lo:101: 00010000:00010000:3.0:1787572256.219724:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572256.219739:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c1462000/0x9fe530ef4f4360f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4360f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.220090:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c1462000/0x9fe530ef4f4360f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4360f2 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.220104:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c1462000/0x9fe530ef4f4360f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4360f2 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.220114:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462000, rc 0) 00000100:00100000:3.0:1787572256.220152:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+10:6688:x1874405268395776:12345-0@lo:101: Request processed in 441us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.220159:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787572256.220251:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268395776:0@lo:101: 00010000:00010000:0.0:1787572256.220264:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.220274:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572256.220382:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268395904:0@lo:501: 00000100:00100000:0.0:1787572256.220407:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572256.220473:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b31c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572256.220747:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268395904 00000100:00100000:3.0:1787572256.220752:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268395904 00000100:00100000:3.0:1787572256.220856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787572256.220871:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+10:6688:x1874405268395904:12345-0@lo:501: 00000100:00100000:3.0:1787572256.221194:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+10:6688:x1874405268395904:12345-0@lo:501: Request processed in 323us (785us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787572256.221202:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787572256.221259:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268395904:0@lo:501: 10000000:01000000:0.0:1787572256.221274:0:6688:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787572256.221303:0:6688:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787572256.221309:0:6688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.221319:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.221326:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.221384:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787572256.221406:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d1cebea800 10000000:01000000:0.0:1787572256.221411:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787572256.221415:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98d1d5ed4d28 10000000:01000000:0.0:1787572256.221418:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787572256.221421:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98d1d5ed4d28 from 1 10000000:01000000:0.0:1787572256.221423:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787572256.221447:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.221453:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.221471:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572256.221485:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396032:0@lo:101: 00000100:00100000:0.0:1787572256.221522:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572256.221553:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b31780 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.221690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268396032 00000100:00100000:1.0:1787572256.221696:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268396032 00000100:00100000:1.0:1787572256.221732:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787572256.221741:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+10:6688:x1874405268396032:12345-0@lo:101: 00010000:00010000:1.0:1787572256.221750:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572256.221830:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436107 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436100 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.221850:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436107 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436100 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.221871:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436107 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436100 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.221878:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c9e00, rc 0) 00000100:00100000:1.0:1787572256.221913:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+11:6688:x1874405268396032:12345-0@lo:101: Request processed in 173us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.221918:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787572256.222105:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396032:0@lo:101: 00010000:00010000:0.0:1787572256.222116:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436107 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.222124:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436107 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572256.222141:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787572256.222161:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436107 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.222169:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436107 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572256.222175:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787572256.222179:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787572256.222184:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787572256.222186:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787572256.222199:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.222206:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.222220:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572256.222231:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396160:0@lo:101: 00000100:00100000:0.0:1787572256.222257:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572256.222285:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b31780 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.222369:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268396160 00000100:00100000:1.0:1787572256.222373:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268396160 00000100:00100000:1.0:1787572256.222402:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787572256.222409:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:6688:x1874405268396160:12345-0@lo:101: 00010000:00010000:1.0:1787572256.222416:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572256.222424:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43610e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.222437:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.222445:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.222452:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8600, rc 0) 00000100:00100000:1.0:1787572256.222489:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268396160:12345-0@lo:101: Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.222495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787572256.222615:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396160:0@lo:101: 00010000:00010000:2.0:1787572256.222663:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.222671:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572256.222742:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396288:0@lo:501: 00000100:00100000:2.0:1787572256.222950:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572256.222973:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e05b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572256.222988:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268396288 00000100:00100000:2.0:1787572256.222991:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268396288 00000100:00100000:2.0:1787572256.223008:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787572256.223082:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268396288:12345-0@lo:501: 00000100:00100000:2.0:1787572256.223284:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268396288:12345-0@lo:501: Request processed in 204us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.223291:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787572256.223325:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396288:0@lo:501: 00000100:00100000:2.0:1787572256.223353:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396416:0@lo:503: 00000100:00100000:2.0:1787572256.223386:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572256.223399:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e05b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572256.223411:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268396416 00000100:00100000:2.0:1787572256.223414:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268396416 00000100:00100000:2.0:1787572256.223430:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787572256.223435:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268396416:12345-0@lo:503: 00000100:00100000:2.0:1787572256.223981:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268396416:12345-0@lo:503: Request processed in 543us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.223988:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1787572256.224129:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572256.224137:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.224145:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:3.0:1787572256.224150:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.224158:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787572256.224164:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572256.224169:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787572256.224192:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.224198:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787572256.224224:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.224232:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4360f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9fe530ef4f4360f9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.224246:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572256.224253:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572256.224255:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572256.224299:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268396544:0@lo:103: 00000100:00100000:2.0:1787572256.224328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.224401:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268396544 00000100:00100000:3.0:1787572256.224406:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268396544 00000100:00100000:3.0:1787572256.224446:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572256.224453:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:3312:x1874405268396544:12345-0@lo:103: 00010000:00010000:3.0:1787572256.224463:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572256.224477:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c1462000/0x9fe530ef4f4360f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f4360f2 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.224489:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572256.224529:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:3312:x1874405268396544:12345-0@lo:103: Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.224535:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572256.224559:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268396544:0@lo:103: 00000100:00100000:0.0:1787572256.224882:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396416:0@lo:503: 00000040:00080000:3.0:1787572256.225304:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787572256.225361:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396672:0@lo:502: 00000100:00100000:3.0:1787572256.225403:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.225470:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.225504:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268396672 00000100:00100000:1.0:1787572256.225918:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268396672 00000100:00100000:1.0:1787572256.225996:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787572256.226074:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:6688:x1874405268396672:12345-0@lo:502: 00000100:00100000:1.0:1787572256.226288:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+11:6688:x1874405268396672:12345-0@lo:502: Request processed in 277us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.226295:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787572256.226378:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396672:0@lo:502: 00000040:00080000:3.0:1787572256.226691:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787572256.226737:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787572256.226768:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787572256.226815:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787572256.226849:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787572256.226898:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787572256.226924:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396800:0@lo:502: 00000100:00100000:3.0:1787572256.226962:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.227001:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787572256.227232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268396800 00000100:00100000:2.0:1787572256.227238:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268396800 00000100:00100000:2.0:1787572256.227274:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787572256.227283:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:6688:x1874405268396800:12345-0@lo:502: 00000100:00100000:2.0:1787572256.227421:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:6688:x1874405268396800:12345-0@lo:502: Request processed in 138us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.227428:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787572256.227552:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396800:0@lo:502: 00000040:00080000:3.0:1787572256.227674:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787572256.227684:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787572256.228322:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787572256.228331:0:6708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787572256.228337:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572256.228339:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787572256.228345:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787572256.228358:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98d1f3c6cd28) 00000020:00000080:0.0:1787572256.228378:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787572256.228385:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787572256.228453:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d1cebea800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787572256.228461:0:6708:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787572256.228467:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9fe530ef4f436123 00010000:00010000:2.0:1787572256.232868:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787572256.233222:0:6708:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787572256.242672:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787572256.243730:0:6708:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787572256.262454:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787572256.270936:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787572256.274441:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787572256.274456:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572256.274463:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572256.274465:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787572256.274468:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787572256.274473:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572256.274474:0:6708:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787572256.274477:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787572256.274479:0:6708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787572256.274537:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572256.274541:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572256.274543:0:6708:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787572256.274546:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787572256.275392:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787572256.275427:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787572256.275452:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.275466:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572256.275474:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1cebea800 from 1 10000000:01000000:3.0:1787572256.275477:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787572256.276959:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.276975:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.276989:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572256.277078:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396928:0@lo:101: 00000100:00100000:3.0:1787572256.277154:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.277313:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787572256.283757:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268396928 00000100:00100000:0.0:1787572256.283947:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268396928 00000100:00100000:0.0:1787572256.284007:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787572256.284120:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:6688:x1874405268396928:12345-0@lo:101: 00010000:00010000:0.0:1787572256.284140:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572256.284158:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43612a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.284186:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.284219:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.284229:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0031800, rc 0) 00000100:00100000:0.0:1787572256.284312:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268396928:12345-0@lo:101: Request processed in 197us (7158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.284371:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268396928:0@lo:101: 00010000:00010000:3.0:1787572256.284389:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572256.284408:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572256.284528:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397056:0@lo:501: 00000100:00100000:3.0:1787572256.284572:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.284604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268397056 00000100:00100000:3.0:1787572256.284609:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268397056 00000100:00100000:0.0:1787572256.290351:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787572256.290719:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.299460:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787572256.299479:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397056:12345-0@lo:501: 00000100:00100000:1.0:1787572256.299819:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397056:12345-0@lo:501: Request processed in 345us (15254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.299827:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787572256.299983:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397056:0@lo:501: 00000100:00100000:3.0:1787572256.300033:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397184:0@lo:503: 00000100:00100000:3.0:1787572256.300081:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.300129:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.300287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268397184 00000100:00100000:1.0:1787572256.300294:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268397184 00000100:00100000:1.0:1787572256.300334:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787572256.300342:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397184:12345-0@lo:503: 00000100:00100000:1.0:1787572256.300669:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397184:12345-0@lo:503: Request processed in 327us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.300676:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787572256.300905:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397184:0@lo:503: 00000040:00080000:3.0:1787572256.301174:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787572256.301240:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397312:0@lo:502: 00000100:00100000:3.0:1787572256.301283:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.301317:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.301480:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268397312 00000100:00100000:1.0:1787572256.301486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268397312 00000100:00100000:1.0:1787572256.301521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787572256.301530:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397312:12345-0@lo:502: 00000100:00100000:1.0:1787572256.301740:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397312:12345-0@lo:502: Request processed in 210us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.301748:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787572256.301951:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397312:0@lo:502: 00000040:00080000:3.0:1787572256.302208:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787572256.302256:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787572256.302284:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397440:0@lo:502: 00000100:00100000:3.0:1787572256.302324:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.302391:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787572256.302846:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268397440 00000100:00100000:2.0:1787572256.302859:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268397440 00000100:00100000:3.0:1787572256.306211:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787572256.306227:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397440:12345-0@lo:502: 00000100:00100000:3.0:1787572256.306574:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397440:12345-0@lo:502: Request processed in 341us (4240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.306582:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787572256.309987:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397440:0@lo:502: 00000040:00080000:2.0:1787572256.311967:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787572256.311990:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787572256.312673:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572256.312684:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572256.312686:0:6713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787572256.312692:0:6713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d1cebea800 00000020:00000080:1.0:1787572256.312703:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787572256.312726:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572256.312730:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572256.312732:0:6713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787572256.312735:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787572256.312952:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787572256.312972:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787572256.312996:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.313006:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572256.313046:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787572256.313050:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d1cebea800 10000000:01000000:2.0:1787572256.313053:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d1cebea800 10000000:01000000:2.0:1787572256.313057:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787572256.313062:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1cebea800 from 1 10000000:01000000:2.0:1787572256.313065:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787572256.313101:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.313109:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.313120:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572256.313140:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397568:0@lo:101: 00000100:00100000:2.0:1787572256.313207:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572256.313257:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1ceb9ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.313347:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268397568 00000100:00100000:1.0:1787572256.313355:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268397568 00000100:00100000:1.0:1787572256.313399:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787572256.313409:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268397568:12345-0@lo:101: 00010000:00010000:1.0:1787572256.313422:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572256.313436:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436138 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.313460:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.313471:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572256.313479:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c9600, rc 0) 00000100:00100000:1.0:1787572256.313523:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268397568:12345-0@lo:101: Request processed in 116us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.313530:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787572256.313668:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397568:0@lo:101: 00010000:00010000:2.0:1787572256.313682:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.313690:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572256.313933:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397696:0@lo:501: 00000100:00100000:2.0:1787572256.313963:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572256.313990:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1ceb9ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.314032:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268397696 00000100:00100000:1.0:1787572256.314036:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268397696 00000100:00100000:1.0:1787572256.314069:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787572256.314077:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268397696:12345-0@lo:501: 00000100:00100000:1.0:1787572256.314354:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268397696:12345-0@lo:501: Request processed in 277us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.314362:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787572256.318978:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397696:0@lo:501: 00000100:00100000:3.0:1787572256.319067:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397824:0@lo:503: 00000100:00100000:3.0:1787572256.319159:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.319205:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d0b1d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572256.319283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268397824 00000100:00100000:0.0:1787572256.319291:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268397824 00000100:00100000:0.0:1787572256.319350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787572256.319360:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268397824:12345-0@lo:503: 00000100:00100000:0.0:1787572256.319576:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268397824:12345-0@lo:503: Request processed in 217us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572256.319584:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787572256.319896:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397824:0@lo:503: 00000040:00080000:3.0:1787572256.320195:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787572256.320268:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397952:0@lo:502: 00000100:00100000:3.0:1787572256.320314:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.320350:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d0b1d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572256.320446:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268397952 00000100:00100000:2.0:1787572256.320452:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268397952 00000100:00100000:2.0:1787572256.320489:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787572256.320498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268397952:12345-0@lo:502: 00000100:00100000:2.0:1787572256.321874:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268397952:12345-0@lo:502: Request processed in 1371us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.321886:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787572256.325692:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268397952:0@lo:502: 00000040:00080000:3.0:1787572256.326150:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787572256.326211:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787572256.326245:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787572256.326290:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787572256.326325:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787572256.326384:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787572256.326422:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787572256.326452:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787572256.326496:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787572256.326533:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787572256.326582:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787572256.327040:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787572256.327091:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787572256.327126:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787572256.327177:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787572256.327213:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787572256.327245:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787572256.327290:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787572256.327324:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787572256.327358:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787572256.327425:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787572256.327464:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787572256.327498:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787572256.327546:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787572256.327597:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787572256.327677:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787572256.327726:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787572256.327773:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787572256.327822:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268398080:0@lo:502: 00000100:00100000:0.0:1787572256.327900:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572256.327961:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2e63b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.328181:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268398080 00000100:00100000:1.0:1787572256.328189:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268398080 00000100:00100000:1.0:1787572256.328234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787572256.328243:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268398080:12345-0@lo:502: 00000100:00100000:1.0:1787572256.328458:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268398080:12345-0@lo:502: Request processed in 216us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572256.328465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787572256.328576:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268398080:0@lo:502: 00000040:00080000:3.0:1787572256.328680:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787572256.328698:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787572256.331137:0:6714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787572256.331156:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98d1c4de0000) 00000020:00000080:3.0:1787572256.331178:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787572256.331273:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d1cebea800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787572256.331277:0:6714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d1cebea800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787572256.331280:0:6714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1cebea800 3 00010000:00080000:3.0:1787572256.331321:0:6714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d0c51a3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.155@tcp at head 00010000:00010000:2.0:1787572256.336202:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787572256.336446:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787572256.336488:0:6714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787572256.336501:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9fe530ef4f43614d 00000100:00080000:2.0:1787572256.336512:0:6714:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787572256.336517:0:6714:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98d0c51a3800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1787572256.336576:0:6714:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1fc4a3480 x1874405268398208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787572256.336605:0:6714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787572256.339005:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874405268398208:0@lo:38: 00000100:00100000:0.0:1787572256.339093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.339296:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572256.339306:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268398336:0@lo:400: 00000100:00100000:3.0:1787572256.339340:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572256.339376:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268398208 00000100:00100000:3.0:1787572256.339384:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268398208 00000100:00100000:3.0:1787572256.339414:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268398336 00000100:00100000:3.0:1787572256.339418:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268398336 00000100:00100000:3.0:1787572256.339446:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787572256.339455:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268398336:12345-0@lo:400: 00000100:00100000:3.0:1787572256.339505:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268398336:12345-0@lo:400: Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.339512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787572256.339529:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787572256.339539:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874405268398208:12345-0@lo:38: 00010000:00080000:3.0:1787572256.339571:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1787572256.339608:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9fe530ef4f436154 00000004:00100000:3.0:1787572256.339622:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787572256.339689:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98d0c51a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787572256.339730:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874405268398208:12345-0@lo:38: Request processed in 190us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572256.339752:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787572256.340047:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d1fc4a6d80 x1874405268398336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572256.340062:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268398336:0@lo:400: 00010000:00080000:3.0:1787572256.340098:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d1fc4a3480 x1874405268398208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787572266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572256.340105:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787572256.340111:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787572256.340118:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787572256.340123:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787572256.340125:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d0c51a3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787572256.340130:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874405268398208:0@lo:38: 00000040:00080000:1.0:1787572256.345254:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787572256.350130:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787572256.350172:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787572256.350195:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572256.350209:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787572256.350262:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787572256.350265:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787572256.350266:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572256.350268:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572256.350269:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572256.350270:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572256.350272:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787572256.350273:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787572256.350275:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787572256.350277:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572256.350278:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787572256.350282:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787572256.350285:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787572256.350286:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787572256.350288:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572256.350289:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572256.350290:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572256.350291:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572256.350298:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787572256.350299:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787572256.350300:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787572256.350300:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572256.350301:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787572256.350341:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787572256.350362:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268398464:0@lo:253: 00000100:00100000:0.0:1787572256.350431:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572256.350488:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2e63180 going to sleep for 11 seconds 00000100:00100000:1.0:1787572256.350579:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268398464 00000100:00100000:1.0:1787572256.350588:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268398464 00000100:00100000:1.0:1787572256.350682:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787572256.350693:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:6688:x1874405268398464:12345-0@lo:253: 20000000:01000000:1.0:1787572256.350721:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787572256.350734:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787572256.371302:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787572256.371324:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787572256.371342:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787572256.371346:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787572256.371368:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371388:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d206279800/0x9fe530ef4f4360ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371396:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371436:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d206279800/0x9fe530ef4f4360ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371451:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d206279800/0x9fe530ef4f4360ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 13 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572256.371467:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874405268398592:0@lo:104: 00000100:00100000:2.0:1787572256.371535:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572256.371598:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d09be6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572256.371622:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268398592 00000100:00100000:2.0:1787572256.371629:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268398592 00000100:00100000:2.0:1787572256.371696:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787572256.371705:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5858:x1874405268398592:12345-0@lo:104: 00010000:00010000:2.0:1787572256.371717:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f4360b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371768:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787572256.371775:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5858:x1874405268398592:12345-0@lo:104: Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.371791:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787572256.371816:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572256.371822:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f4360b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371829:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9200 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:2.0:1787572256.371833:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f4360b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371841:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f4360b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787572256.371847:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f4360b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572256.371852:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787572256.371879:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f4360b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371885:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787572256.371903:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f4360b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371909:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f4360b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4360ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.371924:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572256.371926:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572256.371928:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572256.371948:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268398720:0@lo:103: 00000100:00100000:2.0:1787572256.371984:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572256.372034:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268398720 00000100:00100000:2.0:1787572256.372038:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268398720 00010000:00010000:2.0:1787572256.372054:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d206279800/0x9fe530ef4f4360ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 14 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572256.372075:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787572256.372082:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:3310:x1874405268398720:12345-0@lo:103: 00010000:00010000:2.0:1787572256.372093:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572256.372098:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d206279800/0x9fe530ef4f4360ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 14 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372106:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d206279800/0x9fe530ef4f4360ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 14 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372121:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372128:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787572256.372140:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005101004s 00010000:00010000:2.0:1787572256.372144:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372150:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372156:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372171:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372176:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d206279000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572256.372184:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372190:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372198:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372206:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572256.372235:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:3310:x1874405268398720:12345-0@lo:103: Request processed in 154us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.372241:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787572256.372299:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268398720:0@lo:103: 00010000:00010000:2.0:1787572256.372321:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206279800/0x9fe530ef4f4360ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4360b3 expref: 13 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572256.372330:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874405268398592:0@lo:104: 00010000:00010000:2.0:1787572256.372340:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372348:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372354:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572256.372365:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206279000/0x9fe530ef4f43615b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572256.389286:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:6688:x1874405268398464:12345-0@lo:253: Request processed in 38585us (38845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572256.389300:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787572256.389600:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:6688:1874405268398464:0@lo:253: 10000000:01000000:0.0:1787572256.389617:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787572256.389621:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787572256.389622:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787572256.389623:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572256.389624:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572256.389626:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572256.389627:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572256.389628:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787572256.389630:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787572256.389631:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787572256.389661:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572256.389663:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787572256.389678:0:6688:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787572256.404273:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572256.404467:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572256.405188:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572256.405373:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572256.405590:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787572256.405986:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787572256.407494:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787572256.559708:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787572256.624434:0:6688:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787572256.624443:0:6688:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787572256.624481:0:6688:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787572256.624541:0:6688:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787572256.624570:0:6688:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787572256.624598:0:6688:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787572257.583725:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572258.617735:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572259.635765:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572260.658194:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572261.360029:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268399104:0@lo:400: 00000100:00100000:0.0:1787572261.360107:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572261.360165:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787572261.360171:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268398976:0@lo:400: 00000100:00100000:0.0:1787572261.360195:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572261.360248:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572261.360258:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268398848:0@lo:400: 00000100:00100000:3.0:1787572261.360291:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572261.360334:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268399104 00000100:00100000:3.0:1787572261.360341:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268399104 00000100:00100000:3.0:1787572261.360391:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268398976 00000100:00100000:3.0:1787572261.360394:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268398976 00000100:00100000:3.0:1787572261.360411:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787572261.360421:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268399104:12345-0@lo:400: 00000100:00100000:3.0:1787572261.360482:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268399104:12345-0@lo:400: Request processed in 62us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572261.360503:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787572261.360520:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787572261.360526:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268398976:12345-0@lo:400: 00000100:00100000:3.0:1787572261.360556:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268398976:12345-0@lo:400: Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572261.360561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787572261.360581:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787572261.360610:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1c7cfb100 x1874405268398976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572261.360624:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268398976:0@lo:400: 00010000:00080000:3.0:1787572261.360664:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1c7cf9f80 x1874405268399104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572261.360674:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268399104:0@lo:400: 00000100:00100000:0.0:1787572261.360744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268398848 00000100:00100000:0.0:1787572261.360749:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268398848 00000100:00100000:0.0:1787572261.360779:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787572261.360785:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:3310:x1874405268398848:12345-0@lo:400: 00000100:00100000:0.0:1787572261.360839:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:3310:x1874405268398848:12345-0@lo:400: Request processed in 54us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572261.360845:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787572261.360909:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268398848:0@lo:400: 00010000:00010000:3.0:1787572261.683143:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787572261.870711:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787572261.870719:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1c4a88000 from 21 10000000:01000000:2.0:1787572261.870725:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787572261.870775:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572261.870787:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572261.870800:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572261.870825:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268399232:0@lo:101: 00000100:00100000:2.0:1787572261.870897:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572261.870951:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787572261.871056:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268399232 00000100:00100000:3.0:1787572261.871064:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268399232 00000100:00100000:3.0:1787572261.871511:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787572261.871521:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268399232:12345-0@lo:101: 00010000:00010000:3.0:1787572261.871537:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572261.871550:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436162 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572261.871574:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572261.871598:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572261.871607:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462e00, rc 0) 00000100:00100000:3.0:1787572261.871671:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268399232:12345-0@lo:101: Request processed in 150us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572261.871678:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787572261.871779:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268399232:0@lo:101: 00010000:00010000:2.0:1787572261.871795:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572261.871804:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572261.871858:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268399360:0@lo:501: 00000100:00100000:2.0:1787572261.871887:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572261.871917:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787572261.871976:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268399360 00000100:00100000:3.0:1787572261.871981:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268399360 00000100:00100000:3.0:1787572261.872007:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787572261.872013:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268399360:12345-0@lo:501: 00000100:00100000:3.0:1787572261.873005:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268399360:12345-0@lo:501: Request processed in 988us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572261.873015:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787572261.873156:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268399360:0@lo:501: 00000100:00100000:2.0:1787572261.873197:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268399488:0@lo:503: 00000100:00100000:2.0:1787572261.873242:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572261.873265:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787572261.873278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268399488 00000100:00100000:2.0:1787572261.873283:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268399488 00000100:00100000:2.0:1787572261.873310:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787572261.873317:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268399488:12345-0@lo:503: 00000100:00100000:2.0:1787572261.873592:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268399488:12345-0@lo:503: Request processed in 274us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572261.873599:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787572261.873654:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268399488:0@lo:503: 00000100:00100000:2.0:1787572261.873815:0:7000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:7000:1874405268399616:0@lo:502: 00000100:00100000:2.0:1787572261.873846:0:7000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572261.873859:0:7000:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572261.874097:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268399616 00000100:00100000:3.0:1787572261.874102:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268399616 00000100:00100000:3.0:1787572261.874133:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787572261.874142:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7000:x1874405268399616:12345-0@lo:502: 00000100:00100000:3.0:1787572261.874361:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7000:x1874405268399616:12345-0@lo:502: Request processed in 219us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572261.874368:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787572261.875490:0:7000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:7000:1874405268399616:0@lo:502: 00000100:00100000:2.0:1787572261.875563:0:7000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:7000:1874405268399744:0@lo:502: 00000100:00100000:2.0:1787572261.875609:0:7000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572261.875652:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268399744 00000100:00100000:2.0:1787572261.875657:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268399744 00000100:00100000:2.0:1787572261.875693:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787572261.875701:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7000:x1874405268399744:12345-0@lo:502: 00000100:00100000:2.0:1787572261.875879:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7000:x1874405268399744:12345-0@lo:502: Request processed in 178us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572261.875886:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787572261.877022:0:7000:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572261.877048:0:7000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:7000:1874405268399744:0@lo:502: 00000040:00080000:2.0:1787572261.878576:0:7000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787572261.880623:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787572261.880678:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787572261.880693:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.880708:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572261.880720:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787572261.880724:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d1c4a88000 from 4 10000000:01000000:1.0:1787572261.880727:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787572261.880786:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.880795:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.880807:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572261.880831:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268399872:0@lo:101: 00000100:00100000:1.0:1787572261.880904:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572261.880948:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c53236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572261.881699:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268399872 00000100:00100000:2.0:1787572261.881709:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268399872 00000100:00100000:2.0:1787572261.881762:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787572261.881772:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268399872:12345-0@lo:101: 00010000:00010000:2.0:1787572261.881788:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572261.881803:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436170 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572261.881828:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572261.881840:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572261.881849:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206279000, rc 0) 00000100:00100000:2.0:1787572261.881913:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268399872:12345-0@lo:101: Request processed in 131us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572261.881920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787572261.882056:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268399872:0@lo:101: 00010000:00010000:1.0:1787572261.882081:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.882090:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572261.882140:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268400000:0@lo:256: 00000100:00100000:1.0:1787572261.882173:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572261.882204:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c53236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572261.882219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268400000 00000100:00100000:1.0:1787572261.882223:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268400000 00000100:00100000:1.0:1787572261.882252:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787572261.882258:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268400000:12345-0@lo:256: 20000000:01000000:1.0:1787572261.882270:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787572261.882288:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787572261.882291:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787572261.882371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268400000:12345-0@lo:256: Request processed in 112us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572261.882379:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787572261.882410:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268400000:0@lo:256: 10000000:01000000:1.0:1787572261.882452:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787572261.882472:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.882480:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572261.882488:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787572261.882490:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787572261.882493:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787572261.882512:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.882520:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.882529:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572261.882542:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268400128:0@lo:101: 00000100:00100000:1.0:1787572261.882567:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572261.882580:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c53236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572261.882592:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268400128 00000100:00100000:1.0:1787572261.882595:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268400128 00000100:00100000:1.0:1787572261.882616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787572261.882623:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268400128:12345-0@lo:101: 00010000:00010000:1.0:1787572261.882659:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572261.882669:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43617e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.882683:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.882691:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.882698:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8a00, rc 0) 00000100:00100000:1.0:1787572261.882724:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268400128:12345-0@lo:101: Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572261.882730:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787572261.882758:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268400128:0@lo:101: 00010000:00010000:1.0:1787572261.882767:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.882776:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572261.882819:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268400256:0@lo:501: 00000100:00100000:1.0:1787572261.882842:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572261.882855:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c53236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572261.882865:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268400256 00000100:00100000:1.0:1787572261.882868:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268400256 00000100:00100000:1.0:1787572261.882890:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787572261.882896:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268400256:12345-0@lo:501: 00000100:00100000:1.0:1787572261.886527:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268400256:12345-0@lo:501: Request processed in 3626us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572261.886539:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787572261.892613:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268400256:0@lo:501: 00000100:00100000:2.0:1787572261.892698:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268400384:0@lo:503: 00000100:00100000:2.0:1787572261.893028:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572261.893078:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572261.893174:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268400384 00000100:00100000:1.0:1787572261.893182:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268400384 00000100:00100000:1.0:1787572261.893242:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787572261.893253:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268400384:12345-0@lo:503: 00000100:00100000:1.0:1787572261.893624:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268400384:12345-0@lo:503: Request processed in 373us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572261.893632:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787572261.894053:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268400384:0@lo:503: 00000100:00100000:2.0:1787572261.896329:0:7003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:7003:1874405268400512:0@lo:502: 00000100:00100000:2.0:1787572261.896422:0:7003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572261.896477:0:7003:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572261.899207:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268400512 00000100:00100000:1.0:1787572261.899292:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268400512 00000100:00100000:1.0:1787572261.899433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787572261.899445:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:7003:x1874405268400512:12345-0@lo:502: 00000100:00100000:1.0:1787572261.899829:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:7003:x1874405268400512:12345-0@lo:502: Request processed in 386us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572261.899837:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787572261.899895:0:7003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:7003:1874405268400512:0@lo:502: 00000020:01000000:1.0:1787572261.899928:0:7003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787572261.899936:0:7003:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787572261.899942:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572261.899945:0:7003:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787572261.899949:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787572261.899953:0:7003:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.155@tcp to nid 0x20000c0a8cc9b (192.168.204.155@tcp) 00000020:01000000:1.0:1787572261.899977:0:7003:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787572261.899980:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787572261.900119:0:7003:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98d1d5ed19b8) 00000020:00000080:1.0:1787572261.900207:0:7003:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787572261.900314:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787572261.900393:0:7003:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787572261.900400:0:7003:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787572261.900407:0:7003:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f436193 00010000:00080000:1.0:1787572261.900508:0:7003:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d0c4b80000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1787572261.900859:0:7003:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787572261.966669:0:7003:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787572261.966696:0:7003:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787572261.974396:0:7003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787572261.974604:0:7003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787572261.976866:0:7003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787572261.977061:0:7003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787572261.979924:0:7007:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787572261.979934:0:7007:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787572261.984524:0:7003:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787572261.984541:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787572261.984581:0:7003:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787572261.984606:0:7003:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f43619a 00000100:00080000:2.0:1787572261.984616:0:7003:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787572261.984623:0:7003:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98d0c4b80000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1787572261.984695:0:7003:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1fc4a3100 x1874405268400640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787572261.984716:0:7003:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787572261.984782:0:7003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572261.984786:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572261.984788:0:7003:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787572261.984790:0:7003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1787572261.984946:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268400640:0@lo:8: 00000100:00100000:3.0:1787572261.985017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572261.985100:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268400640 00000100:00100000:3.0:1787572261.985112:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268400640 00000100:00100000:3.0:1787572261.985149:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572261.985157:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874405268400640:12345-0@lo:8: 00010000:00080000:3.0:1787572261.985181:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1787572261.985209:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f4361a1 00002000:00100000:3.0:1787572261.985238:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98d0c51a0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787572261.985243:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787572261.985247:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787572261.985371:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787572261.985520:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787572261.985543:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d0c51a4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787572261.985591:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874405268400640:12345-0@lo:8: Request processed in 432us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572261.985599:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787572261.985652:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a3100 x1874405268400640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787572271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572261.985662:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787572261.985669:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787572261.985676:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787572261.985681:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787572261.985683:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d0c4b80000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787572261.985693:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787572261.985698:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268400640:0@lo:8: 00000020:00000080:2.0:1787572261.985957:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572261.985967:0:7003:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787572261.985974:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787572261.985976:0:7003:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787572261.986002:0:7003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:7003:1874405268400768:0@lo:502: 00000100:00100000:2.0:1787572261.986047:0:7003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572261.986076:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268400768 00000100:00100000:2.0:1787572261.986082:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268400768 00000100:00100000:2.0:1787572261.986110:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787572261.986117:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:7003:x1874405268400768:12345-0@lo:502: 00000100:00100000:2.0:1787572261.986313:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:7003:x1874405268400768:12345-0@lo:502: Request processed in 196us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572261.986320:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787572261.986356:0:7003:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572261.986369:0:7003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:7003:1874405268400768:0@lo:502: 00000020:01000000:2.0:1787572261.986389:0:7003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572261.986393:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572261.986395:0:7003:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787572261.986398:0:7003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:3.0:1787572261.986579:0:7007:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787572261.986692:0:7007:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 192083056061ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787572261.986824:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268401024:0@lo:400: 00000100:00100000:1.0:1787572261.986861:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572261.986891:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572261.986896:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268400896:0@lo:400: 00000100:00100000:1.0:1787572261.986930:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572261.987102:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268401024 00000100:00100000:3.0:1787572261.987107:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268401024 00000100:00100000:3.0:1787572261.987143:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268400896 00000100:00100000:3.0:1787572261.987147:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268400896 00000100:00100000:3.0:1787572261.987162:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572261.987168:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268401024:12345-0@lo:400: 00000100:00100000:3.0:1787572261.987219:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268401024:12345-0@lo:400: Request processed in 50us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572261.987225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572261.987239:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787572261.987245:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268400896:12345-0@lo:400: 00000100:00100000:3.0:1787572261.987272:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268400896:12345-0@lo:400: Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572261.987278:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787572261.987350:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1f3816300 x1874405268400896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572261.987361:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268400896:0@lo:400: 00010000:00080000:1.0:1787572261.987370:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1f3814000 x1874405268401024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572261.987377:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268401024:0@lo:400: 00000020:01000000:0.0:1787572261.987608:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787572261.987659:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787572261.987670:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572261.987681:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572261.987691:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787572261.987694:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d1d5ed4d28 from 1 10000000:01000000:0.0:1787572261.987697:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787572261.987724:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572261.987732:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572261.987742:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572261.987756:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268401152:0@lo:101: 00000100:00100000:0.0:1787572261.987789:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572261.987993:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268401152 00000100:00100000:1.0:1787572261.987999:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268401152 00000100:00100000:1.0:1787572261.988029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787572261.988036:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268401152:12345-0@lo:101: 00010000:00010000:1.0:1787572261.988045:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572261.988058:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4361a8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.988092:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.988103:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572261.988112:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c9a00, rc 0) 00000100:00100000:1.0:1787572261.993248:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268401152:12345-0@lo:101: Request processed in 5202us (5448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572261.993261:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787572261.994950:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c72b5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787572261.994990:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268401152:0@lo:101: 00010000:00010000:0.0:1787572261.995026:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572261.995039:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572261.995117:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268401280:0@lo:501: 00000100:00100000:0.0:1787572261.995166:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572261.995183:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c72b5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787572261.998067:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268401280 00000100:00100000:1.0:1787572261.998082:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268401280 00000100:00100000:1.0:1787572261.998133:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787572261.998142:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268401280:12345-0@lo:501: 00000100:00100000:1.0:1787572261.998368:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268401280:12345-0@lo:501: Request processed in 227us (3201us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787572261.998376:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787572262.000540:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268401280:0@lo:501: 10000000:01000000:0.0:1787572262.000580:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787572262.000590:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572262.000602:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787572262.041487:0:7008:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787572262.041527:0:7008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7008:1874405268401536:0@lo:7: 00000100:00100000:2.0:1787572262.041600:0:7008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787572262.041610:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787572262.041652:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572262.041664:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268401408:0@lo:13: 00000100:00100000:2.0:1787572262.041668:0:7008:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572262.041693:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268401536 00000100:00100000:2.0:1787572262.041700:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268401536 00000100:00100000:2.0:1787572262.041752:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572262.041762:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7008:x1874405268401536:12345-0@lo:7: 00000100:00100000:3.0:1787572262.042663:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572262.042707:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268401408 00000100:00100000:1.0:1787572262.042712:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268401408 00000100:00080000:3.0:1787572262.042717:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787572262.042745:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787572262.042753:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268401408:12345-0@lo:13: 00002000:00000024:1.0:1787572262.042775:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787572262.042841:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268401408:12345-0@lo:13: Request processed in 88us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572262.042847:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787572262.042855:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a2680 x1874405268401408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572262.042875:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268401408:0@lo:13: 00002000:00080000:3.0:1787572262.048551:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787572262.048561:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787572262.048691:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7008:x1874405268401536:12345-0@lo:7: Request processed in 6925us (7086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572262.048702:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787572262.048833:0:7008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a0a80 x1874405268401536/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787572278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572262.048864:0:7008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7008:1874405268401536:0@lo:7: 00000004:00080000:2.0:1787572262.048877:0:7008:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787572262.049034:0:7008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7008:1874405268401664:0@lo:5: 00000100:00100000:2.0:1787572262.049067:0:7008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572262.049107:0:7008:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572262.049202:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268401664 00000100:00100000:1.0:1787572262.049210:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268401664 00000100:00100000:1.0:1787572262.049264:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787572262.049274:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7008:x1874405268401664:12345-0@lo:5: 00002000:00080000:1.0:1787572262.049298:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787572262.049302:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787572262.049576:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7008:x1874405268401664:12345-0@lo:5: Request processed in 303us (508us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787572262.049583:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787572262.049672:0:7008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a0a80 x1874405268401664/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787572278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572262.049684:0:7008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7008:1874405268401664:0@lo:5: 00000004:00080000:2.0:1787572262.049693:0:7008:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787572262.049718:0:7008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7008:1874405268401792:0@lo:700: 00000100:00100000:2.0:1787572262.049743:0:7008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572262.049760:0:7008:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572262.049878:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268401792 00000100:00100000:1.0:1787572262.049883:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268401792 00000100:00100000:1.0:1787572262.050025:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787572262.050034:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7008:x1874405268401792:12345-0@lo:700: 00000100:00100000:1.0:1787572262.050064:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3814000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1874405268401920:0@lo:700: 00000100:00100000:1.0:1787572262.050093:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572262.050108:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787572262.050178:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268401920 00000100:00100000:3.0:1787572262.050182:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268401920 00000100:00100000:3.0:1787572262.050217:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572262.050234:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1874405268401920:12345-0@lo:700: 40000000:02000000:3.0:1787572262.082958:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787572262.091844:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1874405268401920:12345-0@lo:700: Request processed in 41605us (41743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572262.091861:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787572262.091872:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1f3814000 x1874405268401920/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787572278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572262.091886:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3814000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1874405268401920:0@lo:700: 40000000:02000000:1.0:1787572262.091899:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787572262.169005:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7008:x1874405268401792:12345-0@lo:700: Request processed in 118962us (119250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572262.169043:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787572262.169191:0:7008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a0380 x1874405268401792/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787572278 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572262.169208:0:7008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7008:1874405268401792:0@lo:700: 00000001:00080000:2.0:1787572262.169592:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787572262.169607:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1787572262.206812:0:7008:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787572262.214856:0:7008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7008:1874405268402048:0@lo:5: 00000100:00100000:3.0:1787572262.215599:0:7008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572262.215683:0:7008:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2e63f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572262.215840:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268402048 00000100:00100000:0.0:1787572262.215849:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268402048 00000100:00100000:1.0:1787572262.216031:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572262.216048:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7008:x1874405268402048:12345-0@lo:5: 00002000:00080000:1.0:1787572262.234091:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787572262.234118:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787572262.241000:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7008:x1874405268402048:12345-0@lo:5: Request processed in 24948us (25392us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787572262.241015:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787572262.242036:0:7008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a7100 x1874405268402048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787572278 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572262.242051:0:7008:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787572262.242067:0:7008:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98d1fc4a7100 x1874405268402048/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787572278 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572262.242079:0:7008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7008:1874405268402048:0@lo:5: 00000004:00080000:2.0:1787572262.242093:0:7008:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:0.0:1787572262.556133:0:7065:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787572262.703086:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572263.727839:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572264.753388:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572265.774810:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572266.798984:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572266.990872:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268402304:0@lo:400: 00000100:00100000:3.0:1787572266.990963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572266.991036:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572266.991042:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268402432:0@lo:400: 00000100:00100000:3.0:1787572266.991067:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572266.991103:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268402304 00000100:00100000:3.0:1787572266.991110:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268402304 00000100:00100000:3.0:1787572266.991175:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268402432 00000100:00100000:3.0:1787572266.991179:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268402432 00000100:00100000:3.0:1787572266.991209:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787572266.991218:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268402304:12345-0@lo:400: 00000100:00100000:3.0:1787572266.991271:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268402304:12345-0@lo:400: Request processed in 54us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572266.991279:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787572266.991295:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787572266.991311:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268402432:12345-0@lo:400: 00000100:00100000:3.0:1787572266.991338:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268402432:12345-0@lo:400: Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572266.991343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787572266.991376:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787572266.991403:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a5c00 x1874405268402432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572266.991417:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268402432:0@lo:400: 00010000:00080000:3.0:1787572266.991427:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a6680 x1874405268402304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572266.991435:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268402304:0@lo:400: 00000100:00100000:2.0:1787572266.991954:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268402560:0@lo:400: 00000100:00100000:2.0:1787572266.991992:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572266.992036:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572266.992042:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268402176:0@lo:400: 00000100:00100000:2.0:1787572266.992071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572266.992098:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268402560 00000100:00100000:2.0:1787572266.992102:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268402560 00000100:00100000:2.0:1787572266.992159:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572266.992438:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268402560:12345-0@lo:400: 00000100:00100000:2.0:1787572266.992501:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268402560:12345-0@lo:400: Request processed in 336us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572266.992509:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787572266.992533:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787572266.992677:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268402176 00000100:00100000:1.0:1787572266.992683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268402176 00000100:00100000:1.0:1787572266.992717:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787572266.992725:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3312:x1874405268402176:12345-0@lo:400: 00000100:00100000:1.0:1787572266.992758:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3312:x1874405268402176:12345-0@lo:400: Request processed in 35us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572266.992765:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787572266.992921:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268402176:0@lo:400: 00010000:00080000:3.0:1787572266.992998:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a5500 x1874405268402560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572266.993011:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268402560:0@lo:400: 00000100:00100000:2.0:1787572267.503777:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572267.503815:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268402688:0@lo:13: 00000100:00100000:2.0:1787572267.503888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572267.504624:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268402688 00000100:00100000:2.0:1787572267.504658:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268402688 00000100:00100000:2.0:1787572267.504711:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572267.504722:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268402688:12345-0@lo:13: 00002000:00000024:2.0:1787572267.504755:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572267.504818:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268402688:12345-0@lo:13: Request processed in 98us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572267.504825:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787572267.504869:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a0380 x1874405268402688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572267.504890:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268402688:0@lo:13: 00000001:00080000:2.0:1787572267.525521:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787572267.822776:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572268.850116:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572269.880236:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572270.896873:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572271.921654:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572272.110927:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268403200:0@lo:400: 00000100:00100000:3.0:1787572272.111063:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268402816:0@lo:400: 00000100:00100000:3.0:1787572272.111116:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572272.111304:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572272.111310:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268402944:0@lo:400: 00000100:00100000:3.0:1787572272.111338:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572272.111371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268402816 00000100:00100000:3.0:1787572272.111378:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268402816 00000100:00100000:3.0:1787572272.111499:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787572272.111509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3310:x1874405268402816:12345-0@lo:400: 00000100:00100000:3.0:1787572272.111571:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3310:x1874405268402816:12345-0@lo:400: Request processed in 64us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572272.111578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787572272.111613:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268402944 00000100:00100000:3.0:1787572272.111616:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268402944 00000100:00100000:3.0:1787572272.111662:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787572272.111669:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268402944:12345-0@lo:400: 00000100:00100000:3.0:1787572272.111700:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268402944:12345-0@lo:400: Request processed in 32us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572272.111943:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268403072:0@lo:400: 00000100:00100000:0.0:1787572272.111986:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572272.112208:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787572272.112217:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787572272.112235:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787572272.112243:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268403072 00000100:00100000:0.0:1787572272.112247:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268403072 00000100:00100000:2.0:1787572272.112341:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787572272.112375:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572272.112385:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268403200 00000100:00100000:2.0:1787572272.112389:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268403200 00000100:00100000:2.0:1787572272.112422:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572272.112430:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268403200:12345-0@lo:400: 00000100:00100000:2.0:1787572272.112483:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268403200:12345-0@lo:400: Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572272.112489:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787572272.112505:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787572272.112530:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a0e00 x1874405268403200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572272.112541:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787572272.112557:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268403200:0@lo:400: 00010000:00080000:2.0:1787572272.112603:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a3100 x1874405268402944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572272.112613:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268402944:0@lo:400: 00000100:00100000:2.0:1787572272.112623:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268402816:0@lo:400: 00000100:00100000:3.0:1787572272.112723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787572272.116823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787572272.116844:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268403072:12345-0@lo:400: 00000100:00100000:1.0:1787572272.116945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268403072:12345-0@lo:400: Request processed in 110us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572272.116954:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787572272.117248:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a2d80 x1874405268403072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572272.117275:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268403072:0@lo:400: 00000100:00100000:1.0:1787572272.623933:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572272.623964:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268403328:0@lo:13: 00000100:00100000:1.0:1787572272.624054:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572272.625997:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268403328 00000100:00100000:0.0:1787572272.626011:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268403328 00000100:00100000:0.0:1787572272.626086:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787572272.626097:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268403328:12345-0@lo:13: 00002000:00000024:0.0:1787572272.626140:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572272.626219:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268403328:12345-0@lo:13: Request processed in 124us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572272.626226:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787572272.626285:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc4a0380 x1874405268403328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572272.626323:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268403328:0@lo:13: 00010000:00010000:0.0:1787572272.947858:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787572273.840896:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787572273.840903:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787572273.841046:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d1d0ba8000 00000020:01000004:1.0:1787572273.841061:0:7636:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787572273.841075:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787572273.841359:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98d1d5ed0000) 00000020:00000080:1.0:1787572273.841379:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787572273.861170:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787572273.861475:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787572273.890018:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787572273.895369:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787572273.895404:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787572273.895476:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787572273.895509:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787572273.896113:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787572273.896126:0:7636:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787572273.896141:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9fe530ef4f4361bd 00000020:01000004:3.0:1787572273.896151:0:7636:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787572273.896175:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.155@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787572273.896178:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787572273.896183:0:7636:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787572273.896206:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787572273.896211:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787572273.914359:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787572273.914401:0:7636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.155@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787572273.914405:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787572273.914407:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787572273.914408:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572273.914410:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572273.914411:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572273.914412:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572273.914414:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572273.914420:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787572273.914421:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787572273.914422:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572273.914423:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787572273.914427:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787572273.914430:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787572273.914431:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787572273.914432:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572273.914433:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572273.914434:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572273.914435:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572273.914436:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572273.914437:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787572273.914437:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787572273.914438:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572273.914439:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787572273.914471:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787572273.914490:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268403456:0@lo:253: 00000100:00100000:2.0:1787572273.914562:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572273.914932:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1de013a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572273.914975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268403456 00000100:00100000:1.0:1787572273.914983:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268403456 00000100:00100000:3.0:1787572273.915137:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787572273.915149:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:7636:x1874405268403456:12345-0@lo:253: 20000000:01000000:3.0:1787572273.915194:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787572273.915198:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787572273.915204:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787572273.915207:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787572273.916502:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787572273.917267:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787572273.917284:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787572273.917330:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787572273.917339:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787572273.917370:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787572273.917417:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787572273.917880:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787572273.917901:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.155@tcp 20000000:01000000:3.0:1787572273.917903:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:3.0:1787572273.917941:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787572273.917949:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787572273.917997:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787572273.918006:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:3.0:1787572273.918053:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787572273.918063:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787572273.918097:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787572273.918165:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787572273.919394:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787572273.919424:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.155@tcp 20000000:01000000:3.0:1787572273.919426:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:3.0:1787572273.919478:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787572273.919487:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787572273.919519:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787572273.919527:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:3.0:1787572273.919553:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787572273.919562:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787572273.919622:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787572273.919797:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787572273.919817:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787572273.919820:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787572273.919823:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787572273.919835:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787572273.919837:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787572273.919872:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787572273.919875:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787572273.921272:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787572273.921368:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787572273.921403:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787572273.924325:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787572273.924384:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787572273.924452:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787572273.924468:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787572273.924471:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787572273.925401:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787572273.925460:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787572273.925514:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787572273.926099:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787572273.926144:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787572273.926173:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787572273.926186:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787572273.926189:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787572273.926617:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787572273.927001:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787572273.927125:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787572273.927192:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787572273.927206:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787572273.927208:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787572273.929746:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787572273.929836:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787572273.929897:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787572273.930564:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787572273.930607:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787572273.930717:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787572273.930737:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787572273.930740:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787572273.930752:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787572273.930775:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.930797:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.930805:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.930812:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.930840:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.930846:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.930853:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.930899:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.930913:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 16 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572273.930928:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3815180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268403584:0@lo:104: 00000100:00100000:1.0:1787572273.931003:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787572273.931072:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.931081:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572273.931090:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3815c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268403712:0@lo:104: 00010000:00010000:1.0:1787572273.931116:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.931123:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 16 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572273.931141:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268403840:0@lo:104: 00010000:00010000:1.0:1787572273.931169:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.931177:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 16 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572273.931186:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3815f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268403968:0@lo:104: 00010000:00010000:1.0:1787572273.931209:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572273.931217:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 16 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572273.931236:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268404096:0@lo:104: 00000100:00100000:1.0:1787572273.931280:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c7a5a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787572273.931603:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787572273.931624:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572273.931685:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572273.931694:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572273.931701:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572273.931714:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268403584 00000100:00100000:2.0:1787572273.931723:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268403584 00000100:00100000:2.0:1787572273.931784:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268403712 00000100:00100000:2.0:1787572273.931787:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268403712 00000100:00100000:2.0:1787572273.931798:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268403840 00000100:00100000:2.0:1787572273.931800:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268403840 00000100:00100000:2.0:1787572273.931809:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268403968 00000100:00100000:2.0:1787572273.931811:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268403968 00000100:00100000:2.0:1787572273.931821:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268404096 00000100:00100000:2.0:1787572273.931823:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268404096 00000100:00100000:2.0:1787572273.931837:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787572273.931856:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c636b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+7:5837:x1874405268403584:12345-0@lo:104: 00010000:00010000:2.0:1787572273.931869:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572273.931932:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787572273.931938:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c636b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+7:5837:x1874405268403584:12345-0@lo:104: Request processed in 86us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572273.931945:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787572273.931988:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787572273.931997:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+6:5837:x1874405268403712:12345-0@lo:104: 00010000:00010000:2.0:1787572273.932005:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572273.932183:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787572273.932189:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+6:5837:x1874405268403712:12345-0@lo:104: Request processed in 195us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572273.932195:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787572273.932208:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787572273.932217:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+5:5837:x1874405268403840:12345-0@lo:104: 00010000:00010000:2.0:1787572273.932237:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572273.932267:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787572273.932272:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+5:5837:x1874405268403840:12345-0@lo:104: Request processed in 58us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572273.932278:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787572273.932290:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787572273.932297:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+4:5837:x1874405268403968:12345-0@lo:104: 00010000:00010000:2.0:1787572273.932311:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572273.932340:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787572273.932345:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+4:5837:x1874405268403968:12345-0@lo:104: Request processed in 50us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572273.932350:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787572273.932362:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787572273.932370:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5837:x1874405268404096:12345-0@lo:104: 00010000:00010000:2.0:1787572273.932377:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572273.932403:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787572273.932408:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5837:x1874405268404096:12345-0@lo:104: Request processed in 41us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572273.932414:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787572273.932508:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787572273.932516:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932523:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030200 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572273.932528:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932547:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572273.932555:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572273.932561:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787572273.932605:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932611:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572273.932631:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932665:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932691:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787572273.932694:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932699:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9200 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572273.932702:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932708:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572273.932714:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572273.932726:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787572273.932753:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932759:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572273.932775:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932781:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9200/0x9fe530ef4f43617e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932790:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787572273.932793:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932798:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d206279800 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572273.932801:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932808:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572273.932814:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572273.932819:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787572273.932833:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932838:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572273.932850:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932857:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436169 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932867:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787572273.932870:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932876:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d206278600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572273.932879:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932885:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572273.932892:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572273.932897:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787572273.932909:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932914:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572273.932918:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932924:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43613f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932935:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572273.932943:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932949:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031400 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572273.932951:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932957:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572273.932963:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572273.932968:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787572273.932981:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932987:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572273.932991:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.932998:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43610e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436115 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.933013:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572273.933015:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572273.933017:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572273.933174:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268404224:0@lo:103: 00000100:00100000:0.0:1787572273.933220:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572273.933267:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268404736:0@lo:103: 00000100:00100000:0.0:1787572273.933297:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572273.933319:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787572273.933325:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268404608:0@lo:103: 00000100:00100000:0.0:1787572273.933346:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572273.933374:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268404352:0@lo:103: 00000100:00100000:0.0:1787572273.933394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572273.933405:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572273.933410:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268404480:0@lo:103: 00000100:00100000:0.0:1787572273.933429:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572273.933457:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268404224 00000100:00100000:0.0:1787572273.933463:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268404224 00010000:00010000:0.0:1787572273.933486:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 17 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572273.933503:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268404736 00000100:00100000:0.0:1787572273.933506:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268404736 00010000:00010000:0.0:1787572273.933517:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 18 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572273.933527:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268404608 00000100:00100000:0.0:1787572273.933530:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268404608 00010000:00010000:0.0:1787572273.933540:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 19 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572273.933549:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268404352 00000100:00100000:0.0:1787572273.933552:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268404352 00010000:00010000:0.0:1787572273.933562:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 20 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572273.933571:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268404480 00000100:00100000:0.0:1787572273.933579:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268404480 00010000:00010000:0.0:1787572273.933591:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 21 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572273.933605:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787572273.933612:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30d720-8336-413c-aa2f-3c1df9a74652+21:3311:x1874405268404224:12345-0@lo:103: 00010000:00010000:0.0:1787572273.933622:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572273.933627:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 21 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.933663:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 21 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572273.934066:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3815180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268403584:0@lo:104: 00000100:00100000:1.0:1787572273.934078:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3815c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268403712:0@lo:104: 00000100:00100000:1.0:1787572273.934084:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268403840:0@lo:104: 00000100:00100000:1.0:1787572273.934092:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3815f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268403968:0@lo:104: 00000100:00100000:1.0:1787572273.934098:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1874405268404096:0@lo:104: 00010000:00010000:3.0:1787572273.934187:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572273.934480:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.934607:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4361af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4361a8 expref: 21 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572273.934625:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572273.934707:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787572273.934717:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787572273.934864:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787572273.934876:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787572273.934886:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+20:3311:x1874405268404736:12345-0@lo:103: 00010000:00010000:3.0:1787572273.934899:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572273.934906:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 20 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.934915:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 20 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.934937:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f436115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43610e expref: 20 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.934947:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572273.935000:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268404736:12345-0@lo:103: Request processed in 117us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572273.935007:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787572273.935101:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787572273.935111:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787572273.935118:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:3311:x1874405268404608:12345-0@lo:103: 00010000:00010000:3.0:1787572273.935126:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572273.935131:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 18 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935139:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 18 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935148:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43613f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436138 expref: 18 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935157:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572273.935182:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:3311:x1874405268404608:12345-0@lo:103: Request processed in 66us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572273.935188:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787572273.935198:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787572273.935204:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787572273.935210:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3312:x1874405268404352:12345-0@lo:103: 00010000:00010000:3.0:1787572273.935217:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572273.935240:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935249:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935260:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f436185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43617e expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935270:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572273.935301:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:3312:x1874405268404352:12345-0@lo:103: Request processed in 91us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572273.935307:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787572273.935318:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787572273.935325:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787572273.935330:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:3312:x1874405268404480:12345-0@lo:103: 00010000:00010000:3.0:1787572273.935338:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572273.935342:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 14 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935352:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 14 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935361:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f436169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436162 expref: 14 pid: 5836 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935392:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935401:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935425:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935432:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935438:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935444:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935449:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c8000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572273.935453:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935460:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935551:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935561:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572273.935587:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3312:x1874405268404480:12345-0@lo:103: Request processed in 257us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572273.935593:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787572273.935615:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935623:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572273.935767:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8000/0x9fe530ef4f4361c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787572273.935782:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787572273.935854:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268404480:0@lo:103: 00000100:00100000:3.0:1787572273.935863:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268404352:0@lo:103: 00000100:00100000:3.0:1787572273.935894:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268404608:0@lo:103: 00000100:00100000:3.0:1787572273.935903:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268404736:0@lo:103: 00000100:00100000:0.0:1787572273.942277:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:3311:x1874405268404224:12345-0@lo:103: Request processed in 8655us (9046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572273.942291:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787572273.942619:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268404224:0@lo:103: 00010000:00010000:0.0:1787572273.969056:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572274.062681:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+11:7636:x1874405268403456:12345-0@lo:253: Request processed in 147490us (148072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572274.062696:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787572274.063243:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268403456:0@lo:253: 10000000:01000000:0.0:1787572274.063264:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787572274.063268:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787572274.063269:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787572274.063271:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572274.063272:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787572274.063273:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572274.063274:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572274.063276:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787572274.063277:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787572274.063279:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572274.063287:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787572274.063310:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d1d0ba8000 from lustre-OST0001 10000000:01000000:0.0:1787572274.063337:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787572274.063340:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787572274.063347:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98d1d5ed4d28 local copy 10000000:01000000:0.0:1787572274.063351:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787572274.063392:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.063404:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.063414:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.063434:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268404864:0@lo:101: 00000100:00100000:0.0:1787572274.063478:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.063626:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d16929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572274.064499:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268404864 00000100:00100000:1.0:1787572274.064509:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268404864 00000100:00100000:1.0:1787572274.066535:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787572274.066556:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+11:7636:x1874405268404864:12345-0@lo:101: 00010000:00010000:1.0:1787572274.066575:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572274.066598:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c8800/0x9fe530ef4f4361d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4361cb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.066629:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c8800/0x9fe530ef4f4361d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4361cb expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.066679:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c8800/0x9fe530ef4f4361d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4361cb expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.066689:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8800, rc 0) 00000100:00100000:1.0:1787572274.066767:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+12:7636:x1874405268404864:12345-0@lo:101: Request processed in 220us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.066775:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787572274.066890:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268404864:0@lo:101: 00010000:00010000:0.0:1787572274.066913:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.066923:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.070277:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268404992:0@lo:501: 00000100:00100000:0.0:1787572274.070361:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.071707:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d16929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572274.074362:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268404992 00000100:00100000:2.0:1787572274.074379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268404992 00000100:00100000:2.0:1787572274.074456:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787572274.074468:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:7636:x1874405268404992:12345-0@lo:501: 00000100:00100000:0.0:1787572274.075172:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268404992:0@lo:501: 10000000:01000000:0.0:1787572274.075195:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787572274.075252:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787572274.075260:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.075272:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.075280:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.075305:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787572274.075329:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d1d0ba8000 10000000:01000000:0.0:1787572274.075334:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787572274.075339:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787572274.075342:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787572274.075347:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787572274.075349:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787572274.075377:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.075384:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.075394:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.075410:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405120:0@lo:101: 00010000:00010000:1.0:1787572274.075655:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572274.075662:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.075680:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031400 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572274.075684:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.075693:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572274.075699:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572274.075713:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572274.075735:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.075741:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572274.075762:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.075769:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f4361cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9fe530ef4f4361d2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.075782:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572274.075784:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572274.075786:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572274.075797:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268405248:0@lo:103: 00000100:00100000:0.0:1787572274.075953:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.075985:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572274.076171:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268405120 00000100:00100000:3.0:1787572274.076180:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268405120 00000100:00100000:3.0:1787572274.076214:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787572274.076237:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268405120:12345-0@lo:101: 00010000:00010000:3.0:1787572274.076248:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572274.076261:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4361d9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572274.076283:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572274.076292:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572274.076300:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462e00, rc 0) 00000100:00100000:3.0:1787572274.076358:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268405120:12345-0@lo:101: Request processed in 135us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572274.076364:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787572274.076489:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405120:0@lo:101: 00010000:00010000:0.0:1787572274.076509:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.076517:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.076591:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405376:0@lo:501: 00000100:00100000:0.0:1787572274.076628:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.076661:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572274.076836:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268405376 00000100:00100000:3.0:1787572274.076841:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268405376 00000100:00100000:3.0:1787572274.076859:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787572274.076866:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268405376:12345-0@lo:501: 00000100:00100000:3.0:1787572274.077298:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268405376:12345-0@lo:501: Request processed in 431us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572274.077306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787572274.077678:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405376:0@lo:501: 00000100:00100000:0.0:1787572274.077717:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405504:0@lo:503: 00000100:00100000:0.0:1787572274.077757:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.077787:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572274.077895:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268405504 00000100:00100000:3.0:1787572274.077900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268405504 00000100:00100000:3.0:1787572274.077923:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787572274.077930:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268405504:12345-0@lo:503: 00000100:00100000:3.0:1787572274.078109:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268405504:12345-0@lo:503: Request processed in 179us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572274.078116:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787572274.078317:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405504:0@lo:503: 00000040:00080000:0.0:1787572274.078624:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787572274.078823:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405632:0@lo:502: 00000100:00100000:0.0:1787572274.078862:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.078883:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572274.078948:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268405632 00000100:00100000:3.0:1787572274.078953:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268405632 00000100:00100000:3.0:1787572274.078977:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787572274.078984:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268405632:12345-0@lo:502: 00000100:00100000:3.0:1787572274.079272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268405632:12345-0@lo:502: Request processed in 288us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572274.079280:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787572274.079414:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405632:0@lo:502: 00000040:00080000:0.0:1787572274.079757:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787572274.079809:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787572274.079839:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787572274.079887:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787572274.079923:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787572274.079957:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787572274.079983:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405760:0@lo:502: 00000100:00100000:2.0:1787572274.080186:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268404992:12345-0@lo:501: Request processed in 5718us (9822us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787572274.080194:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787572274.080295:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.080319:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572274.080420:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268405760 00000100:00100000:3.0:1787572274.080428:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268405760 00000100:00100000:3.0:1787572274.080466:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787572274.080474:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268405760:12345-0@lo:502: 00000100:00100000:3.0:1787572274.080656:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268405760:12345-0@lo:502: Request processed in 160us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572274.080663:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787572274.080870:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405760:0@lo:502: 00000040:00080000:0.0:1787572274.080972:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787572274.080983:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787572274.081893:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787572274.081902:0:7644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787572274.081909:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572274.081911:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787572274.081916:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787572274.081930:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98d1c4de3370) 00000020:00000080:3.0:1787572274.081954:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787572274.081960:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787572274.082107:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d1d0ba8000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787572274.082117:0:7644:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787572274.082135:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9fe530ef4f4361ee 00000100:00100000:1.0:1787572274.082961:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.083477:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268405248 00000100:00100000:0.0:1787572274.083489:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268405248 00000100:00100000:0.0:1787572274.083552:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787572274.083563:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3312:x1874405268405248:12345-0@lo:103: 00010000:00010000:0.0:1787572274.083577:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572274.083600:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8800/0x9fe530ef4f4361d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f4361cb expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.083617:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572274.083893:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:3312:x1874405268405248:12345-0@lo:103: Request processed in 331us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.083901:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787572274.083972:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268405248:0@lo:103: 00010000:00010000:3.0:1787572274.091333:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787572274.093030:0:7644:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787572274.100981:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787572274.102526:0:7644:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787572274.110930:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787572274.111881:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787572274.115612:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787572274.115626:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572274.115654:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572274.115656:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787572274.115660:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572274.115665:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572274.115789:0:7644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787572274.115796:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787572274.115799:0:7644:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787572274.115874:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572274.115882:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572274.115883:0:7644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787572274.115887:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787572274.116194:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787572274.116237:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787572274.116269:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.116281:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572274.116289:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1d0ba8000 from 1 10000000:01000000:0.0:1787572274.116292:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787572274.116386:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.116406:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.116418:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.116445:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405888:0@lo:101: 00000100:00100000:0.0:1787572274.116531:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.116631:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572274.119275:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268405888 00000100:00100000:3.0:1787572274.119294:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268405888 00000100:00100000:3.0:1787572274.120794:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787572274.120813:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+12:7636:x1874405268405888:12345-0@lo:101: 00010000:00010000:3.0:1787572274.120837:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572274.120859:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4361f5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572274.120893:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572274.120904:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572274.120923:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463e00, rc 0) 00000100:00100000:3.0:1787572274.121035:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268405888:12345-0@lo:101: Request processed in 220us (4494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572274.121042:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787572274.122287:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268405888:0@lo:101: 00010000:00010000:0.0:1787572274.122312:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.122324:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.122458:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406016:0@lo:501: 00000100:00100000:0.0:1787572274.122509:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.122744:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692900 going to sleep for 11 seconds 00000100:00100000:1.0:1787572274.125855:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268406016 00000100:00100000:1.0:1787572274.125871:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268406016 00000100:00100000:1.0:1787572274.125930:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787572274.125942:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406016:12345-0@lo:501: 00000100:00100000:1.0:1787572274.126295:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406016:12345-0@lo:501: Request processed in 354us (3785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.126303:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787572274.126373:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406016:0@lo:501: 00000100:00100000:1.0:1787572274.126428:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406144:0@lo:503: 00000100:00100000:1.0:1787572274.126476:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572274.126506:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c7a5ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572274.126522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268406144 00000100:00100000:1.0:1787572274.126526:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268406144 00000100:00100000:1.0:1787572274.126545:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787572274.126550:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406144:12345-0@lo:503: 00000100:00100000:1.0:1787572274.126891:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406144:12345-0@lo:503: Request processed in 340us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.126898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787572274.126937:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406144:0@lo:503: 00000040:00080000:1.0:1787572274.127245:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787572274.127316:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406272:0@lo:502: 00000100:00100000:1.0:1787572274.127353:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572274.127377:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c7a5ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572274.127392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268406272 00000100:00100000:1.0:1787572274.127403:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268406272 00000100:00100000:1.0:1787572274.127424:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787572274.127430:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406272:12345-0@lo:502: 00000100:00100000:1.0:1787572274.127574:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406272:12345-0@lo:502: Request processed in 143us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.127582:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787572274.127662:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406272:0@lo:502: 00000040:00080000:1.0:1787572274.127911:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787572274.127958:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787572274.127981:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406400:0@lo:502: 00000100:00100000:1.0:1787572274.128014:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572274.128040:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c7a5ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572274.128055:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268406400 00000100:00100000:1.0:1787572274.128059:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268406400 00000100:00100000:1.0:1787572274.128077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787572274.128082:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406400:12345-0@lo:502: 00000100:00100000:1.0:1787572274.128191:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406400:12345-0@lo:502: Request processed in 107us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.128198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787572274.128264:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406400:0@lo:502: 00000040:00080000:1.0:1787572274.128336:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787572274.128346:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787572274.128628:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572274.128663:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572274.128666:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787572274.128673:0:7648:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d1d0ba8000 00000020:00000080:1.0:1787572274.128675:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787572274.132513:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572274.132527:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572274.132529:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787572274.132534:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787572274.132793:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787572274.132828:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787572274.132850:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.132863:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572274.132929:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787572274.132932:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d1d0ba8000 10000000:01000000:0.0:1787572274.132935:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d1d0ba8000 10000000:01000000:0.0:1787572274.132940:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787572274.132947:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1d0ba8000 from 1 10000000:01000000:0.0:1787572274.132950:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787572274.132992:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.133001:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.133144:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.133168:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406528:0@lo:101: 00000100:00100000:0.0:1787572274.133255:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.133297:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572274.133336:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268406528 00000100:00100000:0.0:1787572274.133345:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268406528 00000100:00100000:0.0:1787572274.133386:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787572274.133397:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268406528:12345-0@lo:101: 00010000:00010000:0.0:1787572274.133413:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572274.133428:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436203 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.133453:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.133473:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.133481:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0031e00, rc 0) 00000100:00100000:0.0:1787572274.133522:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268406528:12345-0@lo:101: Request processed in 126us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.133530:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787572274.133578:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406528:0@lo:101: 00010000:00010000:0.0:1787572274.133594:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572274.133603:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.133804:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406656:0@lo:501: 00000100:00100000:0.0:1787572274.133831:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.133845:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572274.133859:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268406656 00000100:00100000:0.0:1787572274.133862:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268406656 00000100:00100000:0.0:1787572274.133880:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787572274.133887:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268406656:12345-0@lo:501: 00000100:00100000:0.0:1787572274.134599:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268406656:12345-0@lo:501: Request processed in 710us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.134607:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787572274.134903:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406656:0@lo:501: 00000100:00100000:3.0:1787572274.134945:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406784:0@lo:503: 00000100:00100000:3.0:1787572274.134991:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572274.135456:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f41ad0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572274.135496:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268406784 00000100:00100000:2.0:1787572274.135503:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268406784 00000100:00100000:2.0:1787572274.135605:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787572274.135627:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268406784:12345-0@lo:503: 00000100:00100000:1.0:1787572274.136481:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268406784:12345-0@lo:503: Request processed in 855us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.136490:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787572274.136602:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406784:0@lo:503: 00000040:00080000:3.0:1787572274.136934:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787572274.137036:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406912:0@lo:502: 00000100:00100000:3.0:1787572274.137082:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572274.138145:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f41ad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572274.138346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268406912 00000100:00100000:0.0:1787572274.138356:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268406912 00000100:00100000:0.0:1787572274.138412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787572274.138422:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268406912:12345-0@lo:502: 00000100:00100000:0.0:1787572274.138869:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268406912:12345-0@lo:502: Request processed in 448us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.138878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787572274.145601:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268406912:0@lo:502: 00000040:00080000:3.0:1787572274.146591:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787572274.146827:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787572274.146867:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787572274.147290:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787572274.147338:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787572274.148213:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787572274.148433:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787572274.148470:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787572274.148538:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787572274.148572:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787572274.148599:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787572274.148985:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787572274.149213:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787572274.149262:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787572274.149319:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787572274.149357:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787572274.149410:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787572274.149460:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787572274.149499:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787572274.149534:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787572274.149582:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787572274.149622:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787572274.150178:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787572274.151855:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787572274.151922:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787572274.151954:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787572274.152265:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787572274.152304:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787572274.152332:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787572274.152381:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787572274.152416:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787572274.152449:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787572274.152499:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787572274.152550:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787572274.152588:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787572274.153873:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787572274.153984:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787572274.154056:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268407040:0@lo:502: 00000100:00100000:3.0:1787572274.154142:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572274.154185:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f41ad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572274.154342:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268407040 00000100:00100000:0.0:1787572274.154351:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268407040 00000100:00100000:0.0:1787572274.154405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787572274.154415:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268407040:12345-0@lo:502: 00000100:00100000:0.0:1787572274.154742:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268407040:12345-0@lo:502: Request processed in 327us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.154750:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787572274.155172:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268407040:0@lo:502: 00000040:00080000:3.0:1787572274.155268:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787572274.155279:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787572274.156166:0:7649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787572274.156193:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98d0c5804d28) 00000020:00000080:3.0:1787572274.156218:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787572274.156302:0:7649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d1d0ba8000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787572274.156306:0:7649:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d1d0ba8000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787572274.156309:0:7649:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1d0ba8000 3 00010000:00080000:3.0:1787572274.156338:0:7649:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d0c6517800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.155@tcp at head 00010000:00010000:0.0:1787572274.161568:0:7649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787572274.165717:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787572274.165839:0:7649:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787572274.165859:0:7649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9fe530ef4f436218 00000100:00080000:0.0:1787572274.166000:0:7649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787572274.166008:0:7649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98d0c6517800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1787572274.166083:0:7649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1c7cf9880 x1874405268407168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787572274.166112:0:7649:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787572274.166149:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874405268407168:0@lo:38: 00000100:00100000:0.0:1787572274.166215:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268407296:0@lo:400: 00000100:00100000:2.0:1787572274.166261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572274.166331:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268407552:0@lo:400: 00000100:00100000:2.0:1787572274.166361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572274.166383:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787572274.166389:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268407424:0@lo:400: 00000100:00100000:2.0:1787572274.166422:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268407552 00000100:00100000:2.0:1787572274.166430:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268407552 00000100:00100000:2.0:1787572274.166489:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787572274.166498:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572274.166511:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268407552:12345-0@lo:400: 00000100:00100000:0.0:1787572274.166541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268407168 00000100:00100000:0.0:1787572274.166544:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268407168 00000100:00100000:2.0:1787572274.166563:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268407552:12345-0@lo:400: Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.166563:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268407296 00000100:00100000:0.0:1787572274.166565:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268407296 00000100:00100000:2.0:1787572274.166570:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787572274.166589:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572274.166596:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787572274.166602:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268407296:12345-0@lo:400: 00000100:00100000:0.0:1787572274.166662:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268407296:12345-0@lo:400: Request processed in 60us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.166668:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787572274.166682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787572274.166686:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874405268407168:12345-0@lo:38: 00010000:00080000:0.0:1787572274.166706:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1787572274.166736:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9fe530ef4f43621f 00000004:00100000:0.0:1787572274.166753:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787572274.166860:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98d1fbda3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787572274.167036:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874405268407168:12345-0@lo:38: Request processed in 348us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.167043:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787572274.167070:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787572274.167098:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1c7cfad80 x1874405268407552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572274.167112:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268407552:0@lo:400: 00000100:00100000:0.0:1787572274.167134:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268407424 00000100:00100000:0.0:1787572274.167137:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268407424 00000100:00100000:0.0:1787572274.167163:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787572274.167170:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268407424:12345-0@lo:400: 00000100:00100000:0.0:1787572274.167202:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268407424:12345-0@lo:400: Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.167207:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787572274.167232:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787572274.167492:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1c7cfb800 x1874405268407424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572274.167503:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268407424:0@lo:400: 00010000:00080000:0.0:1787572274.167537:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1c7cf9880 x1874405268407168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787572284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572274.167545:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787572274.167552:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787572274.167559:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787572274.167564:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787572274.167567:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d0c6517800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787572274.167574:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874405268407168:0@lo:38: 00010000:00080000:2.0:1787572274.167849:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1c7cfbb80 x1874405268407296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572274.167858:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268407296:0@lo:400: 00000040:00080000:0.0:1787572274.168065:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787572274.168736:0:7650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7650:1874405268407680:0@lo:901: 00000020:01000000:2.0:1787572274.168880:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787572274.168919:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787572274.168944:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572274.168956:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572274.169210:0:7650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1787572274.169312:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787572274.169315:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787572274.169317:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572274.169318:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572274.169319:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:0.0:1787572274.169319:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268407680 00000020:01000004:2.0:1787572274.169321:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572274.169323:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572274.169325:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787572274.169326:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:0.0:1787572274.169327:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268407680 00000020:01000004:2.0:1787572274.169328:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572274.169329:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787572274.169333:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787572274.169336:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787572274.169338:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787572274.169339:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572274.169340:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572274.169341:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572274.169342:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572274.169343:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572274.169344:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787572274.169345:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787572274.169346:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572274.169348:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787572274.169370:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787572274.169381:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268407808:0@lo:253: 00000100:00100000:2.0:1787572274.169433:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572274.169601:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787572274.169612:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7650:x1874405268407680:12345-0@lo:901: 00000100:00100000:0.0:1787572274.170546:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7650:x1874405268407680:12345-0@lo:901: Request processed in 933us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572274.170556:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787572274.170586:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572274.170600:0:7650:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d16929c0 going to sleep for 11 seconds 00010000:00080000:0.0:1787572274.170627:0:7650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1c7cf9880 x1874405268407680/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787572290 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572274.170669:0:7650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7650:1874405268407680:0@lo:901: 00000100:00100000:2.0:1787572274.173162:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787572274.181621:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268407808 00000100:00100000:3.0:1787572274.181675:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268407808 00000100:00100000:3.0:1787572274.183134:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787572274.183151:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:7636:x1874405268407808:12345-0@lo:253: 20000000:01000000:3.0:1787572274.183196:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787572274.183214:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787572274.215082:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787572274.215104:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787572274.215216:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787572274.215233:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787572274.215261:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572274.215286:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572274.215317:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572274.215374:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572274.215391:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 14 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572274.215408:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874405268407936:0@lo:104: 00000100:00100000:2.0:1787572274.215509:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572274.215574:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572274.215899:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268407936 00000100:00100000:1.0:1787572274.215909:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268407936 00000100:00100000:1.0:1787572274.215981:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787572274.215992:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5858:x1874405268407936:12345-0@lo:104: 00010000:00010000:1.0:1787572274.216007:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216067:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787572274.216074:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:5858:x1874405268407936:12345-0@lo:104: Request processed in 84us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.216080:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787572274.216103:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572274.216109:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216117:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9000 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572274.216121:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216137:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572274.216143:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572274.216158:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572274.216188:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216195:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572274.216214:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216233:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9000/0x9fe530ef4f436170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216256:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572274.216258:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572274.216259:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572274.216283:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268408064:0@lo:103: 00000100:00100000:1.0:1787572274.216318:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572274.216357:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268408064 00000100:00100000:1.0:1787572274.216361:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268408064 00010000:00010000:1.0:1787572274.216379:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 15 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572274.216401:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787572274.216409:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+15:3312:x1874405268408064:12345-0@lo:103: 00010000:00010000:1.0:1787572274.216432:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572274.216439:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 15 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216450:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 15 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216475:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216482:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787572274.216494:0:7642:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005101004s 00010000:00010000:1.0:1787572274.216498:0:7642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216504:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216512:0:7642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216518:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216523:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d206279a00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572274.216528:0:7642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216534:0:7642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216542:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.216552:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572274.216582:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+15:3312:x1874405268408064:12345-0@lo:103: Request processed in 174us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.216594:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787572274.217068:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268408064:0@lo:103: 00010000:00010000:1.0:1787572274.217100:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206279000/0x9fe530ef4f436177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436170 expref: 14 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572274.217111:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874405268407936:0@lo:104: 00010000:00010000:1.0:1787572274.217134:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.217142:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.217147:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572274.217153:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206279a00/0x9fe530ef4f436226 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572274.249914:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:7636:x1874405268407808:12345-0@lo:253: Request processed in 66758us (80469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572274.249996:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787572274.250205:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d30d720-8336-413c-aa2f-3c1df9a74652:7636:1874405268407808:0@lo:253: 10000000:01000000:2.0:1787572274.250233:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787572274.250237:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787572274.250239:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787572274.250240:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572274.250242:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572274.250243:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572274.250244:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572274.250246:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572274.250247:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787572274.250249:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787572274.250250:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572274.250252:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787572274.250267:0:7636:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787572274.261164:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787572274.263670:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787572274.264571:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787572274.264844:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787572274.266210:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787572274.266700:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787572274.269105:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787572274.563980:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787572274.563987:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787572274.564032:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787572274.564109:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787572274.564129:0:7636:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787572274.564157:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787572274.992304:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572276.014893:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572277.045973:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572277.742991:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268408192:0@lo:13: 00000100:00100000:1.0:1787572277.743088:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572277.743179:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268408192 00000100:00100000:1.0:1787572277.743188:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268408192 00000100:00100000:1.0:1787572277.743267:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572277.743295:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268408192:12345-0@lo:13: 00002000:00000024:1.0:1787572277.743336:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572277.743405:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268408192:12345-0@lo:13: Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572277.743412:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787572277.743451:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a5180 x1874405268408192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572277.743468:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268408192:0@lo:13: 00000100:00080000:3.0:1787572277.743861:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787572278.063924:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572279.087514:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572279.280866:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268408448:0@lo:400: 00000100:00100000:2.0:1787572279.280937:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572279.280991:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787572279.280997:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268408320:0@lo:400: 00000100:00100000:2.0:1787572279.281024:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572279.281046:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268408832:0@lo:400: 00000100:00100000:2.0:1787572279.281066:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572279.281088:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268408576:0@lo:400: 00000100:00100000:2.0:1787572279.281111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572279.281149:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572279.281155:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268408704:0@lo:400: 00000100:00100000:2.0:1787572279.281179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572279.281215:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268408448 00000100:00100000:2.0:1787572279.281223:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268408448 00000100:00100000:2.0:1787572279.281283:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268408832 00000100:00100000:2.0:1787572279.281287:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268408832 00000100:00100000:2.0:1787572279.281307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268408576 00000100:00100000:2.0:1787572279.281310:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268408576 00000100:00100000:2.0:1787572279.281333:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787572279.281338:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268408320 00000100:00100000:2.0:1787572279.281340:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268408448:12345-0@lo:400: 00000100:00100000:1.0:1787572279.281341:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268408320 00000100:00100000:1.0:1787572279.281366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787572279.281372:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3311:x1874405268408320:12345-0@lo:400: 00000100:00100000:2.0:1787572279.281390:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268408448:12345-0@lo:400: Request processed in 50us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572279.281397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787572279.281399:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:3311:x1874405268408320:12345-0@lo:400: Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572279.281404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787572279.281412:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787572279.281419:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268408832:12345-0@lo:400: 00000100:00100000:2.0:1787572279.281446:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268408832:12345-0@lo:400: Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572279.281462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787572279.281482:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787572279.281491:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268408576:12345-0@lo:400: 00000100:00100000:2.0:1787572279.281532:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268408576:12345-0@lo:400: Request processed in 44us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572279.281538:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787572279.281562:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268408704 00000100:00100000:2.0:1787572279.281566:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268408704 00010000:00080000:1.0:1787572279.281693:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a3100 x1874405268408576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572279.281708:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268408576:0@lo:400: 00000100:00080000:3.0:1787572279.281838:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572279.282374:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787572279.282386:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268408704:12345-0@lo:400: 00000100:00100000:2.0:1787572279.282437:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268408704:12345-0@lo:400: Request processed in 55us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572279.282443:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787572279.282810:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54000 x1874405268408704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572279.282824:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268408704:0@lo:400: 00000100:00100000:1.0:1787572279.284305:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268408320:0@lo:400: 00010000:00080000:1.0:1787572279.284333:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54700 x1874405268408832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572279.284351:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268408832:0@lo:400: 00010000:00080000:1.0:1787572279.284365:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a2d80 x1874405268408448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572279.284373:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268408448:0@lo:400: 00000100:00080000:0.0:1787572279.284787:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787572280.112094:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787572280.809187:0:7992:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787572281.135063:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787572281.839712:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787572281.839729:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1cebea800 from 30 10000000:01000000:1.0:1787572281.839735:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787572281.839789:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572281.839800:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572281.839813:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572281.839839:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3815f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268408960:0@lo:101: 00000100:00100000:1.0:1787572281.839911:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.839965:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.840101:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268408960 00000100:00100000:3.0:1787572281.840111:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268408960 00000100:00100000:3.0:1787572281.840174:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787572281.840197:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268408960:12345-0@lo:101: 00010000:00010000:3.0:1787572281.840211:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572281.840223:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43622d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.840248:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.840256:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.840265:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462200, rc 0) 00000100:00100000:3.0:1787572281.840327:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268408960:12345-0@lo:101: Request processed in 132us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.840335:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787572281.840559:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3815f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268408960:0@lo:101: 00010000:00010000:0.0:1787572281.840575:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.840585:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572281.840662:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409088:0@lo:501: 00000100:00100000:0.0:1787572281.840691:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572281.840712:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.840886:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268409088 00000100:00100000:3.0:1787572281.840891:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268409088 00000100:00100000:3.0:1787572281.840916:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787572281.840923:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268409088:12345-0@lo:501: 00000100:00100000:3.0:1787572281.841277:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268409088:12345-0@lo:501: Request processed in 353us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.841284:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787572281.841846:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409088:0@lo:501: 00000100:00100000:0.0:1787572281.841877:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409216:0@lo:503: 00000100:00100000:0.0:1787572281.841916:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572281.841936:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.842057:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268409216 00000100:00100000:3.0:1787572281.842063:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268409216 00000100:00100000:3.0:1787572281.842108:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787572281.842116:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268409216:12345-0@lo:503: 00000100:00100000:3.0:1787572281.842441:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268409216:12345-0@lo:503: Request processed in 325us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.842457:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787572281.842591:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409216:0@lo:503: 00000100:00100000:2.0:1787572281.854470:0:8050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8050:1874405268409344:0@lo:502: 00000100:00100000:2.0:1787572281.854555:0:8050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.854600:0:8050:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c7a5a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.854667:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268409344 00000100:00100000:3.0:1787572281.854674:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268409344 00000100:00100000:3.0:1787572281.854731:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787572281.854743:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:8050:x1874405268409344:12345-0@lo:502: 00000100:00100000:3.0:1787572281.855059:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:8050:x1874405268409344:12345-0@lo:502: Request processed in 317us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.855067:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787572281.855322:0:8050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8050:1874405268409344:0@lo:502: 00000100:00100000:2.0:1787572281.855371:0:8050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8050:1874405268409472:0@lo:502: 00000100:00100000:2.0:1787572281.855403:0:8050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.855423:0:8050:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c7a5a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572281.855481:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268409472 00000100:00100000:0.0:1787572281.855486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268409472 00000100:00100000:0.0:1787572281.855518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787572281.855526:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:8050:x1874405268409472:12345-0@lo:502: 00000100:00100000:0.0:1787572281.855703:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:8050:x1874405268409472:12345-0@lo:502: Request processed in 175us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572281.855710:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787572281.855916:0:8050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8050:1874405268409472:0@lo:502: 00000040:00080000:2.0:1787572281.855936:0:8050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787572281.856114:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787572281.856137:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787572281.856147:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.856170:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572281.856181:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787572281.856184:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787572281.856187:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787572281.856213:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.856221:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.856231:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572281.856245:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409600:0@lo:101: 00000100:00100000:0.0:1787572281.856275:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572281.856310:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572281.856356:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268409600 00000100:00100000:2.0:1787572281.856366:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268409600 00000100:00100000:2.0:1787572281.856400:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787572281.856409:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268409600:12345-0@lo:101: 00010000:00010000:2.0:1787572281.856418:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572281.856430:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43623b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.856450:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.856460:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.856469:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206278e00, rc 0) 00000100:00100000:2.0:1787572281.856502:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268409600:12345-0@lo:101: Request processed in 95us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.856507:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787572281.856537:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409600:0@lo:101: 00010000:00010000:2.0:1787572281.856549:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.856558:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572281.856597:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409728:0@lo:501: 00000100:00100000:2.0:1787572281.856621:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.856665:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c7a5a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787572281.856676:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268409728 00000100:00100000:2.0:1787572281.856679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268409728 00000100:00100000:2.0:1787572281.856706:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787572281.856713:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268409728:12345-0@lo:501: 00000100:00100000:2.0:1787572281.857170:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268409728:12345-0@lo:501: Request processed in 456us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.857177:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787572281.857292:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409728:0@lo:501: 00000100:00100000:0.0:1787572281.857321:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409856:0@lo:503: 00000100:00100000:0.0:1787572281.857360:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572281.857387:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.857438:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268409856 00000100:00100000:3.0:1787572281.857443:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268409856 00000100:00100000:3.0:1787572281.857476:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787572281.857485:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268409856:12345-0@lo:503: 00000100:00100000:3.0:1787572281.858130:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268409856:12345-0@lo:503: Request processed in 645us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.858137:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787572281.858464:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268409856:0@lo:503: 00000100:00100000:2.0:1787572281.860883:0:8052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8052:1874405268409984:0@lo:502: 00000100:00100000:2.0:1787572281.860960:0:8052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.861002:0:8052:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c7a5a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.861128:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268409984 00000100:00100000:3.0:1787572281.861136:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268409984 00000100:00100000:3.0:1787572281.861185:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787572281.861195:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:8052:x1874405268409984:12345-0@lo:502: 00000100:00100000:3.0:1787572281.861469:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:8052:x1874405268409984:12345-0@lo:502: Request processed in 274us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.861478:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787572281.861694:0:8052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8052:1874405268409984:0@lo:502: 00000020:01000000:1.0:1787572281.861723:0:8052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572281.861732:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572281.861734:0:8052:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787572281.861740:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787572281.861747:0:8052:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787572281.861875:0:8052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8052:1874405268410112:0@lo:502: 00000100:00100000:1.0:1787572281.861917:0:8052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.861936:0:8052:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572281.863109:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268410112 00000100:00100000:2.0:1787572281.863122:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268410112 00000100:00100000:2.0:1787572281.863184:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787572281.863193:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:8052:x1874405268410112:12345-0@lo:502: 00000100:00100000:2.0:1787572281.863388:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:8052:x1874405268410112:12345-0@lo:502: Request processed in 196us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.863395:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787572281.864068:0:8052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8052:1874405268410112:0@lo:502: 00000020:01000000:1.0:1787572281.864111:0:8052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572281.864119:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572281.864122:0:8052:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787572281.864126:0:8052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787572281.864873:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787572281.864898:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787572281.864910:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.864934:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572281.864946:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787572281.864948:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1c4a88000 from 30 10000000:01000000:3.0:1787572281.864952:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787572281.864985:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.864993:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.865002:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572281.865337:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268410240:0@lo:101: 00000100:00100000:3.0:1787572281.865394:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572281.865434:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572281.865550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268410240 00000100:00100000:2.0:1787572281.865557:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268410240 00000100:00100000:2.0:1787572281.865609:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787572281.865620:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268410240:12345-0@lo:101: 00010000:00010000:2.0:1787572281.865661:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572281.865676:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436249 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.865699:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.865709:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.865971:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206278200, rc 0) 00000100:00100000:2.0:1787572281.866208:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268410240:12345-0@lo:101: Request processed in 590us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.866216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787572281.872251:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268410240:0@lo:101: 00010000:00010000:1.0:1787572281.872281:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572281.872295:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572281.872377:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268410368:0@lo:501: 00000100:00100000:1.0:1787572281.872434:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.872523:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572281.873152:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268410368 00000100:00100000:2.0:1787572281.873160:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268410368 00000100:00100000:2.0:1787572281.873226:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787572281.873237:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268410368:12345-0@lo:501: 00000100:00100000:2.0:1787572281.873892:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268410368:12345-0@lo:501: Request processed in 655us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.873901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787572281.876722:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268410368:0@lo:501: 00000100:00100000:1.0:1787572281.881612:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268410496:0@lo:503: 00000100:00100000:1.0:1787572281.881713:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.881754:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.881831:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268410496 00000100:00100000:3.0:1787572281.881840:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268410496 00000100:00100000:3.0:1787572281.881896:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787572281.881907:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268410496:12345-0@lo:503: 00000100:00100000:3.0:1787572281.882313:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268410496:12345-0@lo:503: Request processed in 407us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.882321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787572281.882690:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268410496:0@lo:503: 00000100:00100000:0.0:1787572281.886113:0:8054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8054:1874405268410624:0@lo:502: 00000100:00100000:0.0:1787572281.886212:0:8054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572281.886264:0:8054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fbeb33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.886325:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268410624 00000100:00100000:3.0:1787572281.886333:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268410624 00000100:00100000:3.0:1787572281.886383:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787572281.886400:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:8054:x1874405268410624:12345-0@lo:502: 00000100:00100000:3.0:1787572281.886694:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:8054:x1874405268410624:12345-0@lo:502: Request processed in 295us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.886703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787572281.887251:0:8054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8054:1874405268410624:0@lo:502: 00000100:00100000:0.0:1787572281.887313:0:8054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8054:1874405268410752:0@lo:502: 00000100:00100000:0.0:1787572281.887356:0:8054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572281.887386:0:8054:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde72480 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.887677:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268410752 00000100:00100000:3.0:1787572281.887684:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268410752 00000100:00100000:3.0:1787572281.887722:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787572281.887731:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:8054:x1874405268410752:12345-0@lo:502: 00000100:00100000:3.0:1787572281.887997:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:8054:x1874405268410752:12345-0@lo:502: Request processed in 266us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.888005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787572281.888024:0:8054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8054:1874405268410752:0@lo:502: 00000040:00080000:0.0:1787572281.888120:0:8054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787572281.888224:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787572281.888246:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787572281.888256:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.888268:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572281.888278:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787572281.888281:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d1c4a88000 from 5 10000000:01000000:3.0:1787572281.888284:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787572281.888312:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.888320:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.888330:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572281.888352:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268410880:0@lo:101: 00000100:00100000:3.0:1787572281.888381:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572281.888413:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787572281.888564:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268410880 00000100:00100000:0.0:1787572281.888569:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268410880 00000100:00100000:0.0:1787572281.888604:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787572281.888612:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268410880:12345-0@lo:101: 00010000:00010000:0.0:1787572281.888621:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572281.888651:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c0031400/0x9fe530ef4f43625e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436257 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.888807:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c0031400/0x9fe530ef4f43625e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436257 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.888853:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c0031400/0x9fe530ef4f43625e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436257 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.888863:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0031400, rc 0) 00000100:00100000:0.0:1787572281.888903:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268410880:12345-0@lo:101: Request processed in 291us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572281.888910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787572281.889176:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268410880:0@lo:101: 00010000:00010000:3.0:1787572281.889189:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.889198:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572281.889242:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268411008:0@lo:256: 00000100:00100000:3.0:1787572281.889274:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572281.889305:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787572281.889559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268411008 00000100:00100000:0.0:1787572281.889564:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268411008 00000100:00100000:0.0:1787572281.889600:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787572281.889608:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268411008:12345-0@lo:256: 20000000:01000000:0.0:1787572281.889630:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787572281.889667:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787572281.889671:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787572281.889939:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268411008:12345-0@lo:256: Request processed in 331us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572281.889946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787572281.890864:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268411008:0@lo:256: 10000000:01000000:3.0:1787572281.890916:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787572281.890925:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.890935:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572281.890944:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787572281.890946:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787572281.890949:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787572281.890976:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.890993:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.891003:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572281.891018:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268411136:0@lo:101: 00000100:00100000:3.0:1787572281.891067:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572281.891109:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787572281.891136:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268411136 00000100:00100000:0.0:1787572281.891144:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268411136 00000100:00100000:0.0:1787572281.891185:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787572281.891193:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268411136:12345-0@lo:101: 00010000:00010000:0.0:1787572281.891204:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572281.891230:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436265 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.891252:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.891263:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572281.891273:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a31c00, rc 0) 00000100:00100000:0.0:1787572281.891317:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268411136:12345-0@lo:101: Request processed in 125us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572281.891323:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787572281.891359:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268411136:0@lo:101: 00010000:00010000:1.0:1787572281.891372:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572281.891387:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572281.891440:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268411264:0@lo:501: 00000100:00100000:1.0:1787572281.891466:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.891490:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.891620:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268411264 00000100:00100000:3.0:1787572281.891625:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268411264 00000100:00100000:3.0:1787572281.891671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787572281.891678:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268411264:12345-0@lo:501: 00000100:00100000:3.0:1787572281.891933:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268411264:12345-0@lo:501: Request processed in 254us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.891940:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787572281.892006:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268411264:0@lo:501: 00000100:00100000:1.0:1787572281.892046:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268411392:0@lo:503: 00000100:00100000:1.0:1787572281.892092:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.892115:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.892362:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268411392 00000100:00100000:3.0:1787572281.892367:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268411392 00000100:00100000:3.0:1787572281.892401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787572281.892409:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268411392:12345-0@lo:503: 00000100:00100000:3.0:1787572281.892740:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268411392:12345-0@lo:503: Request processed in 331us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.892747:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787572281.892991:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268411392:0@lo:503: 00000100:00100000:1.0:1787572281.893425:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8056:1874405268411520:0@lo:502: 00000100:00100000:1.0:1787572281.893464:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.893497:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.893549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268411520 00000100:00100000:3.0:1787572281.893554:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268411520 00000100:00100000:3.0:1787572281.893586:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787572281.893594:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8056:x1874405268411520:12345-0@lo:502: 00000100:00100000:3.0:1787572281.893943:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8056:x1874405268411520:12345-0@lo:502: Request processed in 348us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.893950:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787572281.894323:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8056:1874405268411520:0@lo:502: 00000020:01000000:1.0:1787572281.894350:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787572281.894358:0:8056:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787572281.894365:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572281.894367:0:8056:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787572281.894372:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787572281.894377:0:8056:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.155@tcp to nid 0x20000c0a8cc9b (192.168.204.155@tcp) 00000020:01000000:1.0:1787572281.894401:0:8056:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787572281.894404:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787572281.894417:0:8056:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98d1d5ed3370) 00000020:00000080:1.0:1787572281.894437:0:8056:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787572281.894449:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787572281.894530:0:8056:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787572281.894536:0:8056:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787572281.894543:0:8056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f43627a 00010000:00080000:1.0:1787572281.894570:0:8056:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d1cdf18000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:0.0:1787572281.897239:0:8056:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787572281.897604:0:8056:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787572281.897619:0:8056:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787572281.898260:0:8056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787572281.898469:0:8056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787572281.898530:0:8056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787572281.898587:0:8056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:2.0:1787572281.901281:0:8056:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787572281.901295:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787572281.901329:0:8056:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787572281.901351:0:8056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f436281 00000100:00080000:2.0:1787572281.901363:0:8056:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787572281.901369:0:8056:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d1cdf18000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1787572281.901403:0:8056:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c5d54e00 x1874405268411648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787572281.901431:0:8056:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787572281.901498:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572281.901502:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572281.901504:0:8056:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787572281.901507:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787572281.901511:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572281.901513:0:8056:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787572281.901516:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787572281.901524:0:8056:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787572281.901557:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8056:1874405268411776:0@lo:502: 00000100:00100000:2.0:1787572281.901665:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.901704:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1692600 going to sleep for 11 seconds 00000100:00100000:2.0:1787572281.902012:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268411776 00000100:00100000:2.0:1787572281.902020:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268411776 00000100:00100000:2.0:1787572281.902145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787572281.902156:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8056:x1874405268411776:12345-0@lo:502: 00000100:00100000:2.0:1787572281.902394:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8056:x1874405268411776:12345-0@lo:502: Request processed in 238us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.902402:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787572281.902445:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268411904:0@lo:400: 00000100:00100000:2.0:1787572281.902474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.902498:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787572281.902504:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268412288:0@lo:400: 00000100:00100000:2.0:1787572281.902525:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.902555:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268412032:0@lo:400: 00000100:00100000:2.0:1787572281.902578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.902596:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572281.902602:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268412160:0@lo:400: 00000100:00100000:2.0:1787572281.902626:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.902679:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268411904 00000100:00100000:2.0:1787572281.902683:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268411904 00000100:00100000:2.0:1787572281.902712:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268412288 00000100:00100000:2.0:1787572281.902715:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268412288 00000100:00100000:2.0:1787572281.902744:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268412032 00000100:00100000:2.0:1787572281.902747:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268412032 00000100:00100000:2.0:1787572281.902763:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787572281.902921:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268411648:0@lo:8: 00000100:00100000:1.0:1787572281.902955:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.903295:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268411904:12345-0@lo:400: 00000100:00100000:2.0:1787572281.903350:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268411904:12345-0@lo:400: Request processed in 574us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.903358:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787572281.903372:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787572281.903381:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268412288:12345-0@lo:400: 00000100:00100000:2.0:1787572281.903409:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268412288:12345-0@lo:400: Request processed in 32us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.903415:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787572281.903426:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787572281.903434:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268412032:12345-0@lo:400: 00000100:00100000:2.0:1787572281.903467:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268412032:12345-0@lo:400: Request processed in 35us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.903472:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787572281.903499:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268412160 00000100:00100000:2.0:1787572281.903503:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268412160 00000100:00100000:2.0:1787572281.903532:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268411648 00000100:00100000:2.0:1787572281.903535:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268411648 00000100:00100000:2.0:1787572281.903545:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787572281.903552:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268412160:12345-0@lo:400: 00000100:00100000:2.0:1787572281.903582:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268412160:12345-0@lo:400: Request processed in 32us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.903587:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787572281.903597:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787572281.903600:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874405268411648:12345-0@lo:8: 00010000:00080000:2.0:1787572281.903623:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1787572281.903681:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f436288 00002000:00100000:2.0:1787572281.903696:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98d0c52f3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787572281.903699:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787572281.903703:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:1.0:1787572281.903905:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d55880 x1874405268412288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572281.903919:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268412288:0@lo:400: 00010000:00080000:1.0:1787572281.903930:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d56d80 x1874405268411904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572281.903939:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268411904:0@lo:400: 00002000:00100000:2.0:1787572281.904164:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787572281.904460:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787572281.904486:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98d0c52f4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572281.904584:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874405268411648:12345-0@lo:8: Request processed in 981us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.904591:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787572281.904655:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54a80 x1874405268412160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572281.904666:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268412160:0@lo:400: 00010000:00080000:2.0:1787572281.904678:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d56680 x1874405268412032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572281.904686:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268412032:0@lo:400: 00000100:00100000:2.0:1787572281.904717:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8056:1874405268411776:0@lo:502: 00000020:01000000:2.0:1787572281.904745:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572281.904752:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572281.904754:0:8056:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787572281.904759:0:8056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787572281.904954:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787572281.904980:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787572281.905003:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.905016:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572281.905028:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787572281.905031:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d1d5ed4d28 from 1 10000000:01000000:3.0:1787572281.905035:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787572281.905250:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.905259:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572281.905268:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572281.905285:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268412416:0@lo:101: 00000100:00100000:3.0:1787572281.905324:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787572281.905363:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572281.905368:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572281.905411:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6e40 going to sleep for 11 seconds 00010000:00080000:1.0:1787572281.905455:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54e00 x1874405268411648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787572291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572281.905465:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787572281.905473:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787572281.905483:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787572281.905489:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787572281.905492:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf18000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787572281.905504:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787572281.905509:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268411648:0@lo:8: 00000040:00080000:1.0:1787572281.905723:0:8057:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787572281.905728:0:8057:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1787572281.905766:0:8057:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787572281.905915:0:8057:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 212002279639ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787572281.906494:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268412416 00000100:00100000:2.0:1787572281.906503:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268412416 00000100:00100000:2.0:1787572281.906882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787572281.906897:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268412416:12345-0@lo:101: 00010000:00010000:2.0:1787572281.906922:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572281.906945:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43628f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.906972:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.906982:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.906991:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206278c00, rc 0) 00000100:00100000:2.0:1787572281.907050:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268412416:12345-0@lo:101: Request processed in 159us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572281.907058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787572281.907124:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268412416:0@lo:101: 00010000:00010000:2.0:1787572281.907143:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.907153:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572281.907994:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268412544:0@lo:501: 00000100:00100000:2.0:1787572281.908032:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572281.908059:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde72d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572281.908085:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268412544 00000100:00100000:2.0:1787572281.908091:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268412544 00000100:00100000:2.0:1787572281.908126:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787572281.908137:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268412544:12345-0@lo:501: 00000100:00100000:2.0:1787572281.909293:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268412544:12345-0@lo:501: Request processed in 1154us (1256us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787572281.909315:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787572281.909373:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268412544:0@lo:501: 10000000:01000000:2.0:1787572281.909421:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787572281.909430:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572281.909440:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787572281.967913:0:8059:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787572281.967949:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3815180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1874405268412800:0@lo:7: 00000100:00100000:1.0:1787572281.968032:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.968096:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86000 going to sleep for 11 seconds 00000004:00080000:1.0:1787572281.968122:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787572281.968144:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268412672:0@lo:13: 00000100:00100000:1.0:1787572281.968172:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572281.968212:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268412672 00000100:00100000:1.0:1787572281.968221:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268412672 00000100:00100000:1.0:1787572281.968285:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787572281.968294:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874405268412672:12345-0@lo:13: 00002000:00000024:1.0:1787572281.968324:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787572281.968369:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874405268412672:12345-0@lo:13: Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572281.968376:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787572281.968412:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3815c00 x1874405268412672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572281.968431:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268412672:0@lo:13: 00000100:00100000:3.0:1787572281.969284:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268412800 00000100:00100000:3.0:1787572281.969292:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268412800 00000100:00100000:3.0:1787572281.969331:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572281.969339:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8059:x1874405268412800:12345-0@lo:7: 00000100:00080000:0.0:1787572281.970421:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1787572281.989431:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787572281.989440:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787572281.989549:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8059:x1874405268412800:12345-0@lo:7: Request processed in 20207us (21513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572281.989560:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787572281.989628:0:8059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3815180 x1874405268412800/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787572297 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572281.989667:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3815180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1874405268412800:0@lo:7: 00000004:00080000:3.0:1787572281.989685:0:8059:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787572281.989734:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1874405268412928:0@lo:5: 00000100:00100000:3.0:1787572281.989768:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572281.989815:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.989834:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268412928 00000100:00100000:3.0:1787572281.989841:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268412928 00000100:00100000:3.0:1787572281.989883:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787572281.989891:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8059:x1874405268412928:12345-0@lo:5: 00002000:00080000:3.0:1787572281.989916:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787572281.989919:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787572281.990137:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8059:x1874405268412928:12345-0@lo:5: Request processed in 246us (368us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787572281.990144:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787572281.990182:0:8059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a7800 x1874405268412928/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787572297 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572281.990193:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1874405268412928:0@lo:5: 00000004:00080000:3.0:1787572281.990202:0:8059:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787572281.990225:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1874405268413056:0@lo:700: 00000100:00100000:3.0:1787572281.990263:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572281.990280:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.990295:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268413056 00000100:00100000:3.0:1787572281.990298:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268413056 00000100:00100000:3.0:1787572281.990325:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787572281.990332:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8059:x1874405268413056:12345-0@lo:700: 00000100:00100000:3.0:1787572281.990361:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1874405268413184:0@lo:700: 00000100:00100000:3.0:1787572281.990405:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572281.990422:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787572281.990441:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268413184 00000100:00100000:3.0:1787572281.990444:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268413184 00000100:00100000:3.0:1787572281.990473:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787572281.990479:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1874405268413184:12345-0@lo:700: 40000000:02000000:3.0:1787572282.074834:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787572282.083414:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1874405268413184:12345-0@lo:700: Request processed in 92923us (92997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572282.083432:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787572282.084023:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a5c00 x1874405268413184/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787572297 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572282.084042:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1874405268413184:0@lo:700: 40000000:02000000:1.0:1787572282.084056:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1787572282.159085:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787572282.214060:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787572282.214091:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1787572282.214450:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8059:x1874405268413056:12345-0@lo:700: Request processed in 224112us (224180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572282.214479:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787572282.214670:0:8059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a4a80 x1874405268413056/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787572297 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572282.214686:0:8059:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787572282.214711:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1874405268413056:0@lo:700: 00000004:02000040:0.0:1787572282.241656:0:8059:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787572282.245293:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1874405268413312:0@lo:5: 00000100:00100000:0.0:1787572282.245367:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572282.245660:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268413312 00000100:00100000:2.0:1787572282.245667:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268413312 00000100:00100000:2.0:1787572282.245726:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787572282.245735:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8059:x1874405268413312:12345-0@lo:5: 00000100:00100000:3.0:1787572282.248803:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a540 going to sleep for 11 seconds 00002000:00080000:3.0:1787572282.255908:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787572282.255932:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787572282.265497:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8059:x1874405268413312:12345-0@lo:5: Request processed in 19749us (20115us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787572282.265514:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787572282.265942:0:8059:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1c7cfa680 x1874405268413312/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787572298 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572282.265962:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8059:1874405268413312:0@lo:5: 00000004:00080000:2.0:1787572282.265977:0:8059:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1787572282.863876:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268413440:0@lo:13: 00000100:00100000:2.0:1787572282.863955:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572282.864106:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268413440 00000100:00100000:1.0:1787572282.864126:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268413440 00000100:00100000:1.0:1787572282.864179:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787572282.864188:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268413440:12345-0@lo:13: 00002000:00000024:1.0:1787572282.864226:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572282.864320:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268413440:12345-0@lo:13: Request processed in 132us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572282.864329:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787572282.864505:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a5180 x1874405268413440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572282.864545:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268413440:0@lo:13: 00010000:00010000:3.0:1787572283.183548:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572284.207762:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572285.232168:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787572285.893773:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787572286.254837:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572286.959041:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268413568:0@lo:400: 00000100:00100000:2.0:1787572286.959045:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268413824:0@lo:400: 00000100:00100000:1.0:1787572286.959120:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268413696:0@lo:400: 00000100:00100000:3.0:1787572286.959187:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268413952:0@lo:400: 00000100:00100000:2.0:1787572286.960791:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572286.961002:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572286.961030:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268413824 00000100:00100000:1.0:1787572286.961033:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268414208:0@lo:400: 00000100:00100000:2.0:1787572286.961050:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268413824 00000100:00100000:1.0:1787572286.961066:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572286.961108:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268413696 00000100:00100000:2.0:1787572286.961112:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268413696 00000100:00100000:2.0:1787572286.961139:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787572286.961149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268413824:12345-0@lo:400: 00000100:00100000:1.0:1787572286.961163:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787572286.961174:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268413696:12345-0@lo:400: 00000100:00100000:2.0:1787572286.961211:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268413824:12345-0@lo:400: Request processed in 63us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572286.961221:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787572286.961229:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268413696:12345-0@lo:400: Request processed in 56us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572286.961237:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787572286.961252:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572286.961269:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268414208 00000100:00100000:2.0:1787572286.961273:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268414208 00010000:00080000:1.0:1787572286.961283:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54a80 x1874405268413696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572286.961298:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268413696:0@lo:400: 00000100:00100000:2.0:1787572286.961308:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787572286.961316:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268414208:12345-0@lo:400: 00010000:00080000:1.0:1787572286.964758:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d57480 x1874405268414208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572286.964776:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787572286.964801:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268414208:0@lo:400: 00000100:00100000:2.0:1787572286.965334:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268414208:12345-0@lo:400: Request processed in 4015us (4264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572286.965345:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787572286.965391:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787572286.965419:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54e00 x1874405268413824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572286.965622:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268413824:0@lo:400: 00000100:00100000:3.0:1787572286.965834:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572286.965970:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268413952 00000100:00100000:2.0:1787572286.965986:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268413952 00000100:00100000:2.0:1787572286.966049:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787572286.966059:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268413952:12345-0@lo:400: 00000100:00100000:2.0:1787572286.966120:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268413952:12345-0@lo:400: Request processed in 62us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572286.966126:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787572286.966154:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d56d80 x1874405268413952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572286.966180:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268413952:0@lo:400: 00000100:00080000:3.0:1787572286.966261:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572286.967960:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572286.971170:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268414080:0@lo:400: 00000100:00100000:1.0:1787572286.971248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572286.971309:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268413568 00000100:00100000:2.0:1787572286.971319:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268413568 00000100:00100000:2.0:1787572286.971385:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787572286.971398:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268413568:12345-0@lo:400: 00000100:00100000:2.0:1787572286.971483:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268413568:12345-0@lo:400: Request processed in 87us (3527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572286.971491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787572286.971690:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268413568:0@lo:400: 00000100:00100000:3.0:1787572286.971819:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268414080 00000100:00100000:3.0:1787572286.971833:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268414080 00000100:00100000:3.0:1787572286.971904:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787572286.971913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268414080:12345-0@lo:400: 00000100:00100000:3.0:1787572286.971964:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268414080:12345-0@lo:400: Request processed in 53us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572286.971971:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787572286.972064:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d55880 x1874405268414080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572286.972079:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268414080:0@lo:400: 00000100:00080000:2.0:1787572286.972082:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787572287.280801:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572287.474908:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787572287.474940:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268414336:0@lo:13: 00000100:00100000:2.0:1787572287.475022:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572287.475114:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268414336 00000100:00100000:2.0:1787572287.475124:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268414336 00000100:00100000:2.0:1787572287.475184:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787572287.475197:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268414336:12345-0@lo:13: 00002000:00000024:2.0:1787572287.475237:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572287.475290:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268414336:12345-0@lo:13: Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572287.475312:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787572287.475379:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d56680 x1874405268414336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572287.475402:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268414336:0@lo:13: 00000100:00100000:3.0:1787572287.492542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572287.492897:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244273024 00000100:00100000:2.0:1787572287.492923:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244273024 00000100:00100000:2.0:1787572287.492986:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 112 00000100:00100000:2.0:1787572287.492995:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1874405244273024:12345-192.168.204.55@tcp:250: 00010000:00080000:2.0:1787572287.493027:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 46025283-1dc6-4449-aad9-047e59682663@192.168.204.55@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1787572287.493061:0:5835:0:(genops.c:1385:class_connect()) connect: client 46025283-1dc6-4449-aad9-047e59682663, cookie 0x9fe530ef4f43629d 00000100:00080000:2.0:1787572287.493218:0:5835:0:(import.c:65:import_set_state_nolock()) ffff98d0c52f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572287.493293:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+5:2352:x1874405244273024:12345-192.168.204.55@tcp:250: Request processed in 297us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572287.493300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 112 00000100:00100000:3.0:1787572287.511467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572287.511544:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244272896 00000100:00100000:2.0:1787572287.511557:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244272896 00000100:00100000:2.0:1787572287.512169:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:2.0:1787572287.512181:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+5:5582:x1874405244272896:12345-192.168.204.55@tcp:101: 00010000:00010000:2.0:1787572287.512198:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572287.512216:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db838 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572287.512245:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572287.512256:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572287.512266:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206278600, rc 0) 00000100:00100000:2.0:1787572287.512342:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+6:5582:x1874405244272896:12345-192.168.204.55@tcp:101: Request processed in 157us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572287.512350:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:0.0:1787572287.521959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572287.522054:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244273152 00000100:00100000:1.0:1787572287.522065:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244273152 00000100:00100000:1.0:1787572287.522124:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:1.0:1787572287.522134:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+6:5582:x1874405244273152:12345-192.168.204.55@tcp:501: 00000100:00100000:1.0:1787572287.522521:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+6:5582:x1874405244273152:12345-192.168.204.55@tcp:501: Request processed in 387us (570us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787572287.522530:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:3.0:1787572287.537875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572287.538099:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244273280 00000100:00100000:0.0:1787572287.538110:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244273280 00000100:00100000:0.0:1787572287.538171:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:0.0:1787572287.538181:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+6:5582:x1874405244273280:12345-192.168.204.55@tcp:101: 00010000:00010000:0.0:1787572287.538200:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572287.538218:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db83f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.538249:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.538261:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.538285:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30400, rc 0) 00000100:00100000:0.0:1787572287.539934:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+7:5582:x1874405244273280:12345-192.168.204.55@tcp:101: Request processed in 1742us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572287.539946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:0.0:1787572287.564103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572287.569554:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244273408 00000100:00100000:2.0:1787572287.569589:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244273408 00000100:00100000:2.0:1787572287.569848:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:2.0:1787572287.569860:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+7:5582:x1874405244273408:12345-192.168.204.55@tcp:501: 00000100:00100000:2.0:1787572287.570193:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+8:5582:x1874405244273408:12345-192.168.204.55@tcp:501: Request processed in 333us (6098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572287.570201:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:3.0:1787572287.576241:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572287.582510:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244273536 00000100:00100000:1.0:1787572287.582526:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244273536 00000100:00100000:1.0:1787572287.582593:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 117 00000100:00100000:1.0:1787572287.582604:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+8:5582:x1874405244273536:12345-192.168.204.55@tcp:503: 00000100:00100000:1.0:1787572287.585238:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+8:5582:x1874405244273536:12345-192.168.204.55@tcp:503: Request processed in 2625us (8996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572287.585254:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 117 00000100:00100000:3.0:1787572287.593132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572287.593354:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244273664 00000100:00100000:1.0:1787572287.593365:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244273664 00000100:00100000:1.0:1787572287.593428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:1.0:1787572287.593439:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+8:5600:x1874405244273664:12345-192.168.204.55@tcp:502: 00000100:00100000:1.0:1787572287.594045:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+8:5600:x1874405244273664:12345-192.168.204.55@tcp:502: Request processed in 605us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572287.594054:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:3.0:1787572287.682165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572287.682266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244273792 00000100:00100000:2.0:1787572287.682277:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244273792 00000100:00100000:2.0:1787572287.682340:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 119 00000100:00100000:2.0:1787572287.682351:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+8:5600:x1874405244273792:12345-192.168.204.55@tcp:502: 00000100:00100000:2.0:1787572287.682675:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+8:5600:x1874405244273792:12345-192.168.204.55@tcp:502: Request processed in 287us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572287.682683:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 119 00000100:00100000:3.0:1787572287.690161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572287.693768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244273920 00000100:00100000:0.0:1787572287.693794:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244273920 00000100:00100000:0.0:1787572287.693896:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:0.0:1787572287.693910:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+8:5582:x1874405244273920:12345-192.168.204.55@tcp:101: 00010000:00010000:0.0:1787572287.694202:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572287.694229:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a30000/0x9fe530ef4f4362b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db869 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.694268:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a30000/0x9fe530ef4f4362b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db869 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.694279:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a30000/0x9fe530ef4f4362b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db869 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.694289:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30000, rc 0) 00000100:00100000:0.0:1787572287.694385:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+9:5582:x1874405244273920:12345-192.168.204.55@tcp:101: Request processed in 478us (4239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572287.694393:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:3.0:1787572287.698364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572287.698830:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244274048 00000100:00100000:2.0:1787572287.698846:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244274048 00000100:00100000:2.0:1787572287.698923:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:2.0:1787572287.698936:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+9:5582:x1874405244274048:12345-192.168.204.55@tcp:256: 20000000:01000000:2.0:1787572287.698979:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787572287.699013:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787572287.699018:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787572287.699021:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787572287.699024:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787572287.707930:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+9:5582:x1874405244274048:12345-192.168.204.55@tcp:256: Request processed in 8976us (9561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572287.707951:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:2.0:1787572287.720270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572287.720373:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244274176 00000100:00100000:0.0:1787572287.720388:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244274176 00000100:00100000:0.0:1787572287.720479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:0.0:1787572287.720841:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+9:5582:x1874405244274176:12345-192.168.204.55@tcp:101: 00010000:00010000:0.0:1787572287.720884:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572287.720909:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db870 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.721128:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.721143:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572287.721153:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30a00, rc 0) 00000100:00100000:0.0:1787572287.721243:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5582:x1874405244274176:12345-192.168.204.55@tcp:101: Request processed in 409us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572287.721250:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:3.0:1787572287.729313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572287.733799:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244274304 00000100:00100000:2.0:1787572287.734106:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244274304 00000100:00100000:2.0:1787572287.734267:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:2.0:1787572287.734282:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:5582:x1874405244274304:12345-192.168.204.55@tcp:501: 00000100:00100000:2.0:1787572287.734778:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:5582:x1874405244274304:12345-192.168.204.55@tcp:501: Request processed in 496us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572287.734787:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:3.0:1787572287.739685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572287.748220:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244274432 00000100:00100000:0.0:1787572287.748246:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244274432 00000100:00100000:0.0:1787572287.748335:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00100000:0.0:1787572287.748349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5582:x1874405244274432:12345-192.168.204.55@tcp:503: 00000100:00100000:0.0:1787572287.749152:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5582:x1874405244274432:12345-192.168.204.55@tcp:503: Request processed in 799us (9520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572287.749163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00100000:3.0:1787572287.759223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572287.760741:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244274560 00000100:00100000:2.0:1787572287.760763:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244274560 00000100:00100000:2.0:1787572287.761345:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00100000:2.0:1787572287.761362:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:5605:x1874405244274560:12345-192.168.204.55@tcp:502: 00000100:00100000:2.0:1787572287.762308:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:5605:x1874405244274560:12345-192.168.204.55@tcp:502: Request processed in 944us (3095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572287.762321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00100000:3.0:1787572287.767221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572287.767874:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244274688 00000100:00100000:0.0:1787572287.767885:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244274688 00000100:00100000:0.0:1787572287.767952:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:0.0:1787572287.767973:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5605:x1874405244274688:12345-192.168.204.55@tcp:502: 00000100:00100000:0.0:1787572287.768240:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5605:x1874405244274688:12345-192.168.204.55@tcp:502: Request processed in 269us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572287.768267:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:3.0:1787572287.777268:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572287.777702:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244274816 00000100:00100000:1.0:1787572287.777713:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244274816 00000100:00100000:1.0:1787572287.778005:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:1.0:1787572287.778015:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1874405244274816:12345-192.168.204.55@tcp:38: 00010000:00080000:1.0:1787572287.778049:0:7555:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1787572287.778106:0:7555:0:(genops.c:1385:class_connect()) connect: client 6d499b5b-e864-4e70-bf3c-7c3a42e124cd, cookie 0x9fe530ef4f4362c0 00000004:00100000:1.0:1787572287.778142:0:7555:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787572287.778147:0:7555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787572287.914277:0:7555:0:(import.c:65:import_set_state_nolock()) ffff98d1fbda3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787572287.914950:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2352:x1874405244274816:12345-192.168.204.55@tcp:38: Request processed in 136933us (137703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572287.914970:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:2.0:1787572287.983014:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268414464:0@lo:13: 00000100:00100000:2.0:1787572287.983090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572287.984039:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268414464 00000100:00100000:3.0:1787572287.984051:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268414464 00000100:00100000:3.0:1787572287.984116:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787572287.984127:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268414464:12345-0@lo:13: 00002000:00000024:3.0:1787572287.984163:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572287.984230:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268414464:12345-0@lo:13: Request processed in 105us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572287.984237:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787572287.985012:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a4380 x1874405268414464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572287.985033:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268414464:0@lo:13: 00010000:00010000:2.0:1787572288.302817:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572288.923422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572288.923471:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572288.923668:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244274944 00000100:00100000:3.0:1787572288.923678:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244274944 00000100:00100000:3.0:1787572288.923755:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244275072 00000100:00100000:3.0:1787572288.923759:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244275072 00000100:00100000:3.0:1787572288.923787:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1787572288.923798:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:0:x1874405244274944:12345-192.168.204.55@tcp:41: 00000004:00000024:3.0:1787572288.923845:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787572288.923914:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:0:x1874405244274944:12345-192.168.204.55@tcp:41: Request processed in 118us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572288.923921:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1787572288.923952:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1787572288.923960:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5582:x1874405244275072:12345-192.168.204.55@tcp:41: 00000004:00000024:3.0:1787572288.923973:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787572288.923994:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5582:x1874405244275072:12345-192.168.204.55@tcp:41: Request processed in 36us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572288.924000:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00080000:0.0:1787572288.924334:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572288.931959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572288.934581:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244275200 00000100:00100000:2.0:1787572288.934600:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244275200 00000100:00100000:2.0:1787572288.934703:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1787572288.934716:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5582:x1874405244275200:12345-192.168.204.55@tcp:40: 00000100:00100000:2.0:1787572288.934947:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5582:x1874405244275200:12345-192.168.204.55@tcp:40: Request processed in 223us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572288.934955:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1787572288.942009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572288.942078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572288.942121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572288.942407:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244275328 00000100:00100000:1.0:1787572288.942420:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244275328 00000100:00100000:1.0:1787572288.942467:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244275456 00000100:00100000:1.0:1787572288.942470:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244275456 00000100:00100000:1.0:1787572288.942484:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1787572288.942493:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874405244275328:12345-192.168.204.55@tcp:8: 00010000:00080000:1.0:1787572288.942537:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:1.0:1787572288.942574:0:6693:0:(genops.c:1385:class_connect()) connect: client 6d499b5b-e864-4e70-bf3c-7c3a42e124cd, cookie 0x9fe530ef4f4362c7 00002000:00100000:1.0:1787572288.942588:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6d499b5b-e864-4e70-bf3c-7c3a42e124cd/ffff98d1cdf1b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787572288.942601:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787572288.943017:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787572288.943056:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf1e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787572288.943124:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2352:x1874405244275328:12345-192.168.204.55@tcp:8: Request processed in 631us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572288.943132:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1787572288.943154:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1787572288.943159:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874405244275456:12345-192.168.204.55@tcp:8: 00010000:00080000:1.0:1787572288.943176:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:1.0:1787572288.943205:0:6693:0:(genops.c:1385:class_connect()) connect: client 6d499b5b-e864-4e70-bf3c-7c3a42e124cd, cookie 0x9fe530ef4f4362ce 00002000:00100000:1.0:1787572288.943211:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d499b5b-e864-4e70-bf3c-7c3a42e124cd/ffff98d1cdf19000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787572288.943227:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787572288.943430:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787572288.943446:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf1d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787572288.943473:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2352:x1874405244275456:12345-192.168.204.55@tcp:8: Request processed in 312us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572288.943480:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:0.0:1787572288.943797:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244275584 00000100:00100000:0.0:1787572288.943804:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244275584 00000100:00100000:0.0:1787572288.943850:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:0.0:1787572288.943859:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5582:x1874405244275584:12345-192.168.204.55@tcp:33: 00000100:00100000:1.0:1787572288.955093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572288.955211:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244275712 00000100:00100000:2.0:1787572288.955225:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244275712 00000100:00100000:2.0:1787572288.955297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 127 00000100:00100000:2.0:1787572288.955309:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244275712:12345-192.168.204.55@tcp:400: 00000100:00100000:2.0:1787572288.955406:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244275712:12345-192.168.204.55@tcp:400: Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572288.955414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 127 00000004:00080000:0.0:1787572288.983605:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39682us 00000004:00200000:2.0:1787572289.009267:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787572289.009465:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5582:x1874405244275584:12345-192.168.204.55@tcp:33: Request processed in 65602us (67380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572289.009480:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000001:00100000:1.0:1787572289.049529:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000100:00100000:1.0:1787572289.210826:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572289.211009:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244275840 00000100:00100000:2.0:1787572289.211021:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244275840 00000100:00100000:2.0:1787572289.211088:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:2.0:1787572289.211099:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5623:x1874405244275840:12345-192.168.204.55@tcp:101: 00010000:00010000:2.0:1787572289.211122:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572289.214950:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d206279800/0x9fe530ef4f4362d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db89a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572289.215073:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d206279000/0x9fe530ef4f4362dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572289.215090:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d206279000/0x9fe530ef4f4362dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572289.215108:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d206279000/0x9fe530ef4f4362dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572289.216723:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787572289.216732:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572289.217061:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d206279000/0x9fe530ef4f4362dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572289.217117:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d206279800/0x9fe530ef4f4362d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db89a expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572289.217139:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d206279000/0x9fe530ef4f4362dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db89a expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572289.217148:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1c3a46000) 00010000:00010000:2.0:1787572289.217151:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787572289.217155:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206279000, rc 0) 00000100:00100000:2.0:1787572289.217241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:5623:x1874405244275840:12345-192.168.204.55@tcp:101: Request processed in 6143us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572289.217250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00010000:00010000:3.0:1787572289.327297:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572290.351245:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572291.374936:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572291.510951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572291.514520:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244275968 00000100:00100000:2.0:1787572291.514535:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244275968 00000100:00100000:2.0:1787572291.514665:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:2.0:1787572291.514677:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:5675:x1874405244275968:12345-192.168.204.55@tcp:41: 00000004:00000024:2.0:1787572291.514724:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787572291.514795:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:5675:x1874405244275968:12345-192.168.204.55@tcp:41: Request processed in 121us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572291.514801:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:0.0:1787572291.515036:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572291.530766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572291.530920:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244276096 00000100:00100000:3.0:1787572291.530937:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244276096 00000100:00100000:3.0:1787572291.531046:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:3.0:1787572291.531062:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:5675:x1874405244276096:12345-192.168.204.55@tcp:13: 00002000:00000024:3.0:1787572291.531117:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572291.531217:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:5675:x1874405244276096:12345-192.168.204.55@tcp:13: Request processed in 160us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572291.531225:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00080000:0.0:1787572291.531344:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787572291.535749:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572291.535904:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244276224 00000100:00100000:3.0:1787572291.535919:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244276224 00000100:00100000:3.0:1787572291.536010:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:3.0:1787572291.536025:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5675:x1874405244276224:12345-192.168.204.55@tcp:13: 00002000:00000024:3.0:1787572291.536083:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572291.536173:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:5675:x1874405244276224:12345-192.168.204.55@tcp:13: Request processed in 152us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572291.536181:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:0.0:1787572291.536765:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787572292.080706:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268414592:0@lo:400: 00000100:00100000:1.0:1787572292.080804:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572292.080866:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268415104:0@lo:400: 00000100:00100000:1.0:1787572292.080912:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572292.080943:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787572292.080949:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268414976:0@lo:400: 00000100:00100000:1.0:1787572292.080979:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572292.081017:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268414976 00000100:00100000:1.0:1787572292.081028:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268414976 00000100:00100000:1.0:1787572292.081114:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787572292.081127:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268414976:12345-0@lo:400: 00000100:00100000:1.0:1787572292.081203:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268414976:12345-0@lo:400: Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572292.081222:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787572292.081285:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4a3100 x1874405268414976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572292.081304:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268414976:0@lo:400: 00000100:00100000:1.0:1787572292.081379:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268415104 00000100:00100000:1.0:1787572292.081382:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268415104 00000100:00100000:1.0:1787572292.081417:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787572292.081425:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268415104:12345-0@lo:400: 00000100:00100000:1.0:1787572292.081465:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268415104:12345-0@lo:400: Request processed in 42us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572292.081471:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787572292.081498:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268415104:0@lo:400: 00000100:00080000:1.0:1787572292.081523:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787572292.081529:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787572292.081554:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268414592 00000100:00100000:1.0:1787572292.081558:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268414592 00000100:00100000:1.0:1787572292.081584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787572292.081591:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268414592:12345-0@lo:400: 00000100:00100000:1.0:1787572292.081629:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268414592:12345-0@lo:400: Request processed in 39us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572292.081664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787572292.081696:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268414720:0@lo:400: 00000100:00100000:1.0:1787572292.081723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572292.081742:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268415232:0@lo:400: 00000100:00100000:1.0:1787572292.081764:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572292.081795:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572292.081802:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268414848:0@lo:400: 00000100:00100000:1.0:1787572292.081826:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572292.081858:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268414592:0@lo:400: 00000100:00100000:1.0:1787572292.081910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268414720 00000100:00100000:1.0:1787572292.081914:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268414720 00000100:00100000:1.0:1787572292.081936:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268414848 00000100:00100000:1.0:1787572292.081939:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268414848 00000100:00100000:1.0:1787572292.081962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787572292.081968:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268414720:12345-0@lo:400: 00000100:00100000:1.0:1787572292.082020:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268414720:12345-0@lo:400: Request processed in 36us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572292.082027:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787572292.082041:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787572292.082048:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268414848:12345-0@lo:400: 00000100:00100000:1.0:1787572292.082078:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268414848:12345-0@lo:400: Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572292.082084:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787572292.082109:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572292.082130:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268414848:0@lo:400: 00000100:00100000:1.0:1787572292.082141:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268414720:0@lo:400: 00000100:00100000:3.0:1787572292.082698:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268415232 00000100:00100000:3.0:1787572292.082704:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268415232 00000100:00100000:3.0:1787572292.082796:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787572292.082808:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268415232:12345-0@lo:400: 00000100:00100000:3.0:1787572292.082864:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268415232:12345-0@lo:400: Request processed in 60us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572292.082871:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787572292.082920:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787572292.082945:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e48000 x1874405268415232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572292.082959:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268415232:0@lo:400: 00000001:00100000:1.0:1787572292.171824:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00010000:00010000:2.0:1787572292.398947:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572292.590974:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572292.591014:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268415360:0@lo:13: 00000100:00100000:1.0:1787572292.591116:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572292.591789:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268415360 00000100:00100000:2.0:1787572292.591814:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268415360 00000100:00100000:2.0:1787572292.591900:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787572292.591913:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268415360:12345-0@lo:13: 00002000:00000024:2.0:1787572292.591968:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572292.592052:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268415360:12345-0@lo:13: Request processed in 140us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572292.592060:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787572292.592110:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54e00 x1874405268415360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572292.592134:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268415360:0@lo:13: 00000100:00100000:0.0:1787572293.102846:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268415488:0@lo:13: 00000100:00100000:0.0:1787572293.102959:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572293.103068:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268415488 00000100:00100000:0.0:1787572293.103079:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268415488 00000100:00100000:0.0:1787572293.103144:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787572293.103155:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268415488:12345-0@lo:13: 00002000:00000024:0.0:1787572293.103202:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572293.103270:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268415488:12345-0@lo:13: Request processed in 116us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572293.103277:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787572293.103328:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1c7cfad80 x1874405268415488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572293.103350:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268415488:0@lo:13: 00000001:00100000:1.0:1787572293.163084:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00010000:00010000:3.0:1787572293.425578:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572293.964389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572293.964452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572293.964493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572293.964530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572293.964582:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244276480 00000100:00100000:1.0:1787572293.964599:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244276480 00000100:00100000:1.0:1787572293.964735:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:1.0:1787572293.964752:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244276480:12345-192.168.204.55@tcp:400: 00000100:00100000:2.0:1787572293.964759:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244276608 00000100:00100000:2.0:1787572293.964766:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244276608 00000100:00100000:2.0:1787572293.964806:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244276736 00000100:00100000:2.0:1787572293.964810:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244276736 00000100:00100000:2.0:1787572293.964832:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:2.0:1787572293.964852:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244276608:12345-192.168.204.55@tcp:400: 00000100:00100000:1.0:1787572293.964865:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244276480:12345-192.168.204.55@tcp:400: Request processed in 117us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572293.964875:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:2.0:1787572293.964892:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244276608:12345-192.168.204.55@tcp:400: Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572293.964901:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:2.0:1787572293.964919:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:2.0:1787572293.964926:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2355:x1874405244276736:12345-192.168.204.55@tcp:400: 00000100:00100000:2.0:1787572293.964954:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2355:x1874405244276736:12345-192.168.204.55@tcp:400: Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572293.964962:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1787572293.965506:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244276352 00000100:00100000:3.0:1787572293.965516:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244276352 00000100:00100000:3.0:1787572293.965570:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 129 00000100:00100000:3.0:1787572293.965579:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:2356:x1874405244276352:12345-192.168.204.55@tcp:400: 00000100:00100000:3.0:1787572293.965656:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:2356:x1874405244276352:12345-192.168.204.55@tcp:400: Request processed in 78us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572293.965663:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 129 00000100:00080000:3.0:1787572293.965724:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572293.965731:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787572293.965735:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787572294.454931:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787572294.557155:0:8307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787572295.471609:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572296.497262:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572297.206261:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268415616:0@lo:400: 00000100:00100000:0.0:1787572297.206366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572297.206687:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268416000:0@lo:400: 00000100:00100000:2.0:1787572297.206727:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572297.206785:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268416000 00000100:00100000:2.0:1787572297.206796:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268416000 00000100:00100000:2.0:1787572297.206889:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787572297.206900:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268416000:12345-0@lo:400: 00000100:00100000:2.0:1787572297.206965:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268416000:12345-0@lo:400: Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572297.206973:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787572297.207024:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbce4380 x1874405268416000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572297.207041:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268416000:0@lo:400: 00000100:00100000:1.0:1787572297.209786:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268415616 00000100:00100000:1.0:1787572297.209809:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268415616 00000100:00100000:1.0:1787572297.209911:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787572297.209925:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268415616:12345-0@lo:400: 00000100:00100000:3.0:1787572297.210947:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268415744:0@lo:400: 00000100:00100000:3.0:1787572297.211023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572297.211080:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572297.211089:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268415872:0@lo:400: 00000100:00100000:3.0:1787572297.211117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787572297.211154:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787572297.211172:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268415744 00000100:00100000:3.0:1787572297.211179:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268415744 00000100:00100000:3.0:1787572297.211224:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268415872 00000100:00100000:3.0:1787572297.211227:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268415872 00000100:00100000:3.0:1787572297.211256:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787572297.211265:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268415744:12345-0@lo:400: 00000100:00100000:3.0:1787572297.211329:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268415744:12345-0@lo:400: Request processed in 65us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572297.211338:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787572297.211358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787572297.211365:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268415872:12345-0@lo:400: 00000100:00100000:3.0:1787572297.211394:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268415872:12345-0@lo:400: Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572297.211400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787572297.211420:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572297.211459:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268415872:0@lo:400: 00000100:00100000:3.0:1787572297.211471:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268415744:0@lo:400: 00000100:00100000:3.0:1787572297.211539:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572297.211548:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874405268416128:0@lo:400: 00000100:00100000:3.0:1787572297.211578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572297.211601:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268416128 00000100:00100000:3.0:1787572297.211604:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268416128 00000100:00100000:3.0:1787572297.211630:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787572297.211676:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874405268416128:12345-0@lo:400: 00000100:00100000:3.0:1787572297.211709:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874405268416128:12345-0@lo:400: Request processed in 36us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572297.211715:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787572297.211729:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572297.211748:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874405268416128:0@lo:400: 00000100:00100000:3.0:1787572297.211798:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268416256:0@lo:400: 00000100:00100000:3.0:1787572297.211830:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572297.211870:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268416256 00000100:00100000:3.0:1787572297.211875:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268416256 00000100:00100000:3.0:1787572297.211910:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787572297.211917:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268416256:12345-0@lo:400: 00000100:00100000:3.0:1787572297.211954:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268416256:12345-0@lo:400: Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572297.211960:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787572297.211974:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787572297.211995:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbce7b80 x1874405268416256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572297.212007:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268416256:0@lo:400: 00000100:00100000:1.0:1787572297.212285:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268415616:12345-0@lo:400: Request processed in 2361us (5917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572297.212296:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787572297.213772:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268415616:0@lo:400: 00010000:00010000:1.0:1787572297.518938:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572297.710828:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787572297.710866:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268416384:0@lo:13: 00000100:00100000:2.0:1787572297.710965:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572297.711052:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268416384 00000100:00100000:2.0:1787572297.711062:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268416384 00000100:00100000:2.0:1787572297.711125:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787572297.711138:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268416384:12345-0@lo:13: 00002000:00000024:2.0:1787572297.711185:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572297.711255:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268416384:12345-0@lo:13: Request processed in 118us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572297.711263:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787572297.711315:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54700 x1874405268416384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572297.711339:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268416384:0@lo:13: 00000100:00100000:2.0:1787572298.223059:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572298.223103:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268416512:0@lo:13: 00000100:00100000:2.0:1787572298.223218:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572298.223329:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268416512 00000100:00100000:2.0:1787572298.223355:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268416512 00000100:00100000:2.0:1787572298.223425:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572298.223436:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268416512:12345-0@lo:13: 00002000:00000024:2.0:1787572298.223484:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572298.223539:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268416512:12345-0@lo:13: Request processed in 104us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572298.223547:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787572298.223604:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1c7cfad80 x1874405268416512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572298.223628:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268416512:0@lo:13: 00010000:00010000:3.0:1787572298.543454:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787572298.967420:0:8456:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7e6477d0 20000000:00000080:0.0:1787572298.967899:0:8456:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d0c689d800 uarg=0000000000000000 20000000:01000000:0.0:1787572298.967954:0:8456:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787572298.967956:0:8456:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787572298.967960:0:8456:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787572298.967967:0:8456:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787572298.967974:0:8456:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787572298.967991:0:8456:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787572298.967993:0:8456:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787572298.968424:0:8456:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787572298.968428:0:8456:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787572298.969860:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787572298.970424:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787572298.970580:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787572298.970622:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787572298.970899:0:8456:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787572298.970903:0:8456:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787572298.971886:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787572298.972395:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787572298.972440:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787572298.972564:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787572298.972577:0:8456:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787572298.972580:0:8456:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787572298.973567:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787572298.974440:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787572298.974595:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787572298.974813:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787572298.974832:0:8456:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787572298.974834:0:8456:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787572298.975883:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787572298.976340:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787572298.976388:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787572298.976440:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1787572298.976533:0:8456:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787572298.976559:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976584:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976594:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976601:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976608:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976616:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976623:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976799:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976810:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976819:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976826:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976881:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.976902:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 9 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.976922:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268416640:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572298.977121:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.977131:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 9 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.977140:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268416768:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572298.977175:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.977194:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 18 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.977205:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268416896:0@lo:104: 00000100:00100000:0.0:1787572298.977259:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787572298.977309:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.977318:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 18 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.977326:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417024:0@lo:104: 00000100:00100000:0.0:1787572298.977353:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787572298.977462:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.977470:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 18 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.977478:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417152:0@lo:104: 00010000:00010000:0.0:1787572298.977506:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.977513:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 18 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.977520:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417280:0@lo:104: 00010000:00010000:0.0:1787572298.977560:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.977572:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 18 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.977580:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417408:0@lo:104: 00010000:00010000:0.0:1787572298.977608:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.977616:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 18 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.977624:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417536:0@lo:104: 00010000:00010000:0.0:1787572298.977681:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.977689:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 18 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.977697:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417664:0@lo:104: 00000100:00100000:0.0:1787572298.977716:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787572298.977865:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787572298.977887:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572298.977901:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572298.977909:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572298.977928:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572298.977942:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572298.977952:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268416896 00000100:00100000:2.0:1787572298.977961:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268416896 00000100:00100000:2.0:1787572298.978010:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268417024 00000100:00100000:2.0:1787572298.978013:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268417024 00000100:00100000:2.0:1787572298.978023:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268417152 00000100:00100000:2.0:1787572298.978025:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268417152 00000100:00100000:2.0:1787572298.978033:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268417280 00000100:00100000:2.0:1787572298.978035:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268417280 00000100:00100000:2.0:1787572298.978042:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268417408 00000100:00100000:2.0:1787572298.978044:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268417408 00000100:00100000:2.0:1787572298.978063:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268417536 00000100:00100000:2.0:1787572298.978065:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268417536 00000100:00100000:2.0:1787572298.978076:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268417664 00000100:00100000:2.0:1787572298.978078:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268417664 00000100:00100000:2.0:1787572298.978093:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787572298.978104:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+9:8456:x1874405268416896:12345-0@lo:104: 00010000:00010000:2.0:1787572298.978119:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572298.978243:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787572298.978251:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+9:8456:x1874405268416896:12345-0@lo:104: Request processed in 149us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572298.978259:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787572298.978284:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572298.978290:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+8:8456:x1874405268417024:12345-0@lo:104: 00010000:00010000:2.0:1787572298.978299:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572298.978337:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787572298.978342:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+8:8456:x1874405268417024:12345-0@lo:104: Request processed in 53us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572298.978348:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572298.978383:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787572298.978390:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+7:8456:x1874405268417152:12345-0@lo:104: 00010000:00010000:2.0:1787572298.978398:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572298.978425:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787572298.978436:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+7:8456:x1874405268417152:12345-0@lo:104: Request processed in 47us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572298.978443:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787572298.978525:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787572298.978532:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+6:8456:x1874405268417280:12345-0@lo:104: 00010000:00010000:2.0:1787572298.978540:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572298.978565:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787572298.978569:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+6:8456:x1874405268417280:12345-0@lo:104: Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572298.978575:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787572298.978585:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787572298.978589:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+5:8456:x1874405268417408:12345-0@lo:104: 00010000:00010000:2.0:1787572298.978596:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572298.978615:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787572298.978620:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+5:8456:x1874405268417408:12345-0@lo:104: Request processed in 30us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572298.978625:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787572298.978660:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787572298.978666:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+4:8456:x1874405268417536:12345-0@lo:104: 00010000:00010000:2.0:1787572298.978672:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572298.978694:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787572298.978704:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+4:8456:x1874405268417536:12345-0@lo:104: Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572298.978709:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787572298.978720:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787572298.978725:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:8456:x1874405268417664:12345-0@lo:104: 00010000:00010000:2.0:1787572298.978732:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572298.978769:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787572298.978773:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:8456:x1874405268417664:12345-0@lo:104: Request processed in 49us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572298.978779:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787572298.979008:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787572298.979017:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979025:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462a00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572298.979030:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979062:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572298.979070:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572298.979077:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572298.979115:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979121:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572298.979140:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979147:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f43628f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436296 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979164:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787572298.979167:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979173:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572298.979177:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979184:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572298.979191:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572298.979201:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572298.979217:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979224:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572298.979240:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979247:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1462c00/0x9fe530ef4f436265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43626c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979256:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787572298.979259:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979264:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463400 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572298.979267:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979274:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572298.979281:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572298.979286:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572298.979295:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979300:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572298.979314:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979320:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1463400/0x9fe530ef4f436249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979330:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787572298.979333:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979339:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031000 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572298.979342:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979348:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572298.979354:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572298.979359:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572298.979369:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979374:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572298.979378:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979384:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f43623b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979391:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787572298.979398:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979404:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9a00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572298.979407:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979413:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572298.979419:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572298.979424:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572298.979434:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979438:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572298.979441:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979447:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9a00/0x9fe530ef4f43622d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436234 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979779:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787572298.979782:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979788:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030e00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572298.979792:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979810:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572298.979817:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572298.979822:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572298.979837:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979842:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572298.979847:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979854:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f436203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43620a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979863:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572298.979867:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979872:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030200 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572298.979875:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979882:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572298.979888:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572298.979897:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572298.979907:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979913:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572298.979917:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979923:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f4361d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361e0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.979936:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572298.979938:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572298.979940:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572298.979969:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268417792:0@lo:103: 00000100:00100000:1.0:1787572298.980020:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572298.980048:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268418304:0@lo:103: 00000100:00100000:1.0:1787572298.980064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572298.980083:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787572298.980088:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268418176:0@lo:103: 00000100:00100000:1.0:1787572298.980104:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572298.980127:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268417920:0@lo:103: 00000100:00100000:1.0:1787572298.980148:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572298.980163:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268418432:0@lo:103: 00000100:00100000:1.0:1787572298.980180:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787572298.982152:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572298.983295:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787572298.983327:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268418048:0@lo:103: 00000100:00100000:1.0:1787572298.983447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572298.984047:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268418560:0@lo:103: 00000100:00100000:1.0:1787572298.984077:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572298.984118:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268417792 00000100:00100000:1.0:1787572298.984129:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268417792 00010000:00010000:1.0:1787572298.984183:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 19 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572298.984301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572298.984334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572298.984397:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268418304 00000100:00100000:1.0:1787572298.984400:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268418304 00010000:00010000:1.0:1787572298.984417:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 20 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572298.984430:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268418176 00000100:00100000:1.0:1787572298.984433:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268418176 00010000:00010000:1.0:1787572298.984444:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 21 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572298.984534:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268417920 00000100:00100000:1.0:1787572298.984537:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268417920 00010000:00010000:1.0:1787572298.984554:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 22 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572298.984564:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268418432 00000100:00100000:1.0:1787572298.984566:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268418432 00010000:00010000:1.0:1787572298.984578:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 23 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572298.984587:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268418048 00000100:00100000:1.0:1787572298.984590:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268418048 00010000:00010000:1.0:1787572298.984600:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 24 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572298.984628:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268418560 00000100:00100000:1.0:1787572298.984631:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268418560 00010000:00010000:1.0:1787572298.984816:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 25 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572298.984829:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244276864 00000100:00100000:1.0:1787572298.984832:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244276864 00010000:00010000:1.0:1787572298.984846:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 10 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572298.984857:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244276992 00000100:00100000:1.0:1787572298.984860:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244276992 00010000:00010000:1.0:1787572298.984871:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 11 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572298.984886:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787572298.984896:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+25:3313:x1874405268417792:12345-0@lo:103: 00010000:00010000:1.0:1787572298.984914:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.984921:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 25 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.984999:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 25 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985026:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572298.985134:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+25:3313:x1874405268417792:12345-0@lo:103: Request processed in 238us (5112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.985143:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787572298.985164:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787572298.985178:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+24:3313:x1874405268418304:12345-0@lo:103: 00010000:00010000:1.0:1787572298.985187:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.985204:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 24 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985213:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 24 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985224:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572298.985252:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+24:3313:x1874405268418304:12345-0@lo:103: Request processed in 75us (5186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.985258:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787572298.985272:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787572298.985278:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+23:3313:x1874405268418176:12345-0@lo:103: 00010000:00010000:1.0:1787572298.985287:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.985291:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 23 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985300:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 23 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985309:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572298.985332:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+23:3313:x1874405268418176:12345-0@lo:103: Request processed in 54us (5226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.985338:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787572298.985350:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787572298.985357:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+22:3310:x1874405268417920:12345-0@lo:103: 00010000:00010000:1.0:1787572298.985365:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.985380:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 22 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985388:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 22 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985398:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572298.985445:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+22:3310:x1874405268417920:12345-0@lo:103: Request processed in 87us (5294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.985528:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787572298.985543:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787572298.985551:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+21:3310:x1874405268418432:12345-0@lo:103: 00010000:00010000:1.0:1787572298.985559:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.985564:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 21 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985572:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 21 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985583:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572298.985607:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+21:3310:x1874405268418432:12345-0@lo:103: Request processed in 58us (5426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.985614:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787572298.985626:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787572298.985632:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+20:3310:x1874405268418048:12345-0@lo:103: 00010000:00010000:1.0:1787572298.985668:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.985673:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 20 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985693:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 20 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985703:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572298.985728:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+20:3310:x1874405268418048:12345-0@lo:103: Request processed in 96us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.985735:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787572298.985761:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787572298.985768:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268418560:12345-0@lo:103: 00010000:00010000:1.0:1787572298.985776:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.985780:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 19 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985788:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 19 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985798:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572298.985820:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268418560:12345-0@lo:103: Request processed in 53us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.985825:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787572298.985839:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:1.0:1787572298.985845:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46025283-1dc6-4449-aad9-047e59682663+11:2354:x1874405244276864:12345-192.168.204.55@tcp:103: 00010000:00010000:1.0:1787572298.985856:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.985860:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 11 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985871:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 11 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.985890:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572298.986385:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206278c00/0x9fe530ef4f436296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43628f expref: 18 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.986403:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268416896:0@lo:104: 00010000:00010000:0.0:1787572298.986620:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a31c00/0x9fe530ef4f43626c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436265 expref: 17 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.986630:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417024:0@lo:104: 00010000:00010000:0.0:1787572298.986658:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206278200/0x9fe530ef4f436250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436249 expref: 16 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.986676:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417152:0@lo:104: 00010000:00010000:0.0:1787572298.986689:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206278e00/0x9fe530ef4f436242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43623b expref: 15 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.986697:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417280:0@lo:104: 00010000:00010000:0.0:1787572298.986707:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c1462200/0x9fe530ef4f436234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43622d expref: 14 pid: 5835 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.986716:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417408:0@lo:104: 00010000:00010000:0.0:1787572298.986727:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c0031e00/0x9fe530ef4f43620a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436203 expref: 13 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.986737:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417536:0@lo:104: 00010000:00010000:0.0:1787572298.986759:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c1462e00/0x9fe530ef4f4361e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4361d9 expref: 12 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.986768:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268417664:0@lo:104: 00010000:00010000:0.0:1787572298.986783:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f4362ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db83f expref: 11 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572298.986792:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268416640:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572298.986802:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874405268416768:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572298.986857:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572298.987078:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268418048:0@lo:103: 00000100:00100000:3.0:1787572298.987089:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268418560:0@lo:103: 00000100:00100000:3.0:1787572298.987098:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268417920:0@lo:103: 00000100:00100000:3.0:1787572298.987107:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268418432:0@lo:103: 00000100:00100000:1.0:1787572298.987386:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244276864:12345-192.168.204.55@tcp:103: Request processed in 1537us (3086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.987396:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:1.0:1787572298.988666:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:1.0:1787572298.988690:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46025283-1dc6-4449-aad9-047e59682663+9:2354:x1874405244276992:12345-192.168.204.55@tcp:103: 00010000:00010000:1.0:1787572298.988719:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572298.988731:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 9 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988761:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 9 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988784:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206278600/0x9fe530ef4f4362a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db838 expref: 9 pid: 5836 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988807:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988817:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988837:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988844:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988852:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988876:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988883:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572298.988889:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988899:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.988921:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572298.989029:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572298.989102:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46025283-1dc6-4449-aad9-047e59682663+8:2354:x1874405244276992:12345-192.168.204.55@tcp:103: Request processed in 422us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572298.989111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00010000:00010000:0.0:1787572298.989283:0:8456:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.989301:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572298.989308:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a31200/0x9fe530ef4f4362e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572298.995518:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268417792:0@lo:103: 00000100:00100000:0.0:1787572298.995858:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268418304:0@lo:103: 00000100:00100000:0.0:1787572298.995893:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268418176:0@lo:103: 00000100:00100000:3.0:1787572299.074133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572299.074188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572299.075344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572299.079423:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244277120 00000100:00100000:1.0:1787572299.082838:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244277120 00000100:00100000:1.0:1787572299.082942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:1.0:1787572299.082954:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244277120:12345-192.168.204.55@tcp:400: 00000100:00100000:1.0:1787572299.083063:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244277120:12345-192.168.204.55@tcp:400: Request processed in 112us (8947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572299.083071:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00080000:3.0:1787572299.084723:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572299.087080:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244277376 00000100:00100000:0.0:1787572299.087102:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244277376 00000100:00100000:0.0:1787572299.087225:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244277248 00000100:00100000:0.0:1787572299.087230:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244277248 00000100:00100000:0.0:1787572299.087264:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:0.0:1787572299.087275:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244277376:12345-192.168.204.55@tcp:400: 00000100:00100000:0.0:1787572299.087390:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244277376:12345-192.168.204.55@tcp:400: Request processed in 115us (13200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572299.087399:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:0.0:1787572299.087420:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:0.0:1787572299.087429:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244277248:12345-192.168.204.55@tcp:400: 00000100:00100000:0.0:1787572299.087472:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244277248:12345-192.168.204.55@tcp:400: Request processed in 45us (12135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572299.087478:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00080000:2.0:1787572299.089504:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572299.089515:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787572299.568603:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572300.591059:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787572300.782911:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787572300.782923:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1d0ba8000 from 39 10000000:01000000:1.0:1787572300.782931:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787572300.783026:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.783041:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.783056:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572300.783089:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268418688:0@lo:101: 00000100:00100000:1.0:1787572300.783201:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572300.783278:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.783440:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268418688 00000100:00100000:2.0:1787572300.783451:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268418688 00000100:00100000:2.0:1787572300.783524:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787572300.783537:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+12:5839:x1874405268418688:12345-0@lo:101: 00010000:00010000:2.0:1787572300.783556:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572300.783575:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d206279a00/0x9fe530ef4f4362f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4362ea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.783607:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206279a00/0x9fe530ef4f4362f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4362ea expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.783632:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d206279a00/0x9fe530ef4f4362f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4362ea expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.783695:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206279a00, rc 0) 00000100:00100000:2.0:1787572300.783766:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268418688:12345-0@lo:101: Request processed in 232us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.783773:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787572300.783980:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268418688:0@lo:101: 00010000:00010000:1.0:1787572300.784000:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.784012:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572300.784078:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268418816:0@lo:501: 00000100:00100000:1.0:1787572300.784106:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572300.784145:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572300.784275:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268418816 00000100:00100000:3.0:1787572300.784281:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268418816 00000100:00100000:3.0:1787572300.784333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787572300.784342:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268418816:12345-0@lo:501: 00000100:00100000:3.0:1787572300.785462:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268418816:12345-0@lo:501: Request processed in 1112us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572300.785475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787572300.789378:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268418816:0@lo:501: 00000100:00100000:1.0:1787572300.789479:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268418944:0@lo:503: 00000100:00100000:1.0:1787572300.789596:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572300.789986:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.793017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268418944 00000100:00100000:2.0:1787572300.793038:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268418944 00000100:00100000:2.0:1787572300.793219:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787572300.793233:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268418944:12345-0@lo:503: 00000100:00100000:2.0:1787572300.793587:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268418944:12345-0@lo:503: Request processed in 356us (3990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.793596:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787572300.793924:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268418944:0@lo:503: 00000100:00100000:3.0:1787572300.795027:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8473:1874405268419072:0@lo:502: 00000100:00100000:3.0:1787572300.795113:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572300.805822:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268419072 00000100:00100000:1.0:1787572300.805856:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268419072 00000100:00100000:2.0:1787572300.809441:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787572300.809478:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:8473:x1874405268419072:12345-0@lo:502: 00000100:00100000:2.0:1787572300.810005:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:8473:x1874405268419072:12345-0@lo:502: Request processed in 545us (14890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.810015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787572300.813497:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1de230000 going to sleep for 11 seconds 00000100:00100000:3.0:1787572300.813561:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8473:1874405268419072:0@lo:502: 00000100:00100000:3.0:1787572300.813725:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8473:1874405268419200:0@lo:502: 00000100:00100000:3.0:1787572300.813829:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.813867:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d5de2480 going to sleep for 11 seconds 00000100:00100000:1.0:1787572300.814855:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268419200 00000100:00100000:1.0:1787572300.814871:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268419200 00000100:00100000:1.0:1787572300.814955:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787572300.814968:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:8473:x1874405268419200:12345-0@lo:502: 00000100:00100000:1.0:1787572300.815347:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+13:8473:x1874405268419200:12345-0@lo:502: Request processed in 381us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572300.815357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787572300.815569:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8473:1874405268419200:0@lo:502: 00000040:00080000:3.0:1787572300.815723:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787572300.816621:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787572300.816699:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787572300.816722:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.816754:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572300.816768:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787572300.816771:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787572300.816774:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787572300.817019:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.817030:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.817044:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572300.817077:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268419328:0@lo:101: 00000100:00100000:0.0:1787572300.818430:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572300.818487:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787572300.824396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268419328 00000100:00100000:1.0:1787572300.824420:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268419328 00000100:00100000:1.0:1787572300.824512:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787572300.824524:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+13:5839:x1874405268419328:12345-0@lo:101: 00010000:00010000:1.0:1787572300.824547:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572300.824571:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f4362ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4362f8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.824622:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f4362ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4362f8 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.824680:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f4362ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4362f8 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.824692:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8a00, rc 0) 00000100:00100000:1.0:1787572300.824803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268419328:12345-0@lo:101: Request processed in 281us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572300.824810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787572300.824868:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268419328:0@lo:101: 00010000:00010000:0.0:1787572300.824893:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.824904:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572300.825076:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268419456:0@lo:501: 00000100:00100000:0.0:1787572300.825122:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572300.825305:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787572300.825314:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268419456 00000100:00100000:1.0:1787572300.825319:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268419456 00000100:00100000:0.0:1787572300.825479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787572300.825487:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268419456:12345-0@lo:501: 00000100:00100000:0.0:1787572300.829209:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268419456:12345-0@lo:501: Request processed in 3705us (4069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.829229:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787572300.829443:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268419456:0@lo:501: 00000100:00100000:3.0:1787572300.829521:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268419584:0@lo:503: 00000100:00100000:3.0:1787572300.829586:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.829660:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1de2309c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.829947:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268419584 00000100:00100000:2.0:1787572300.829956:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268419584 00000100:00100000:2.0:1787572300.830018:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787572300.830029:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268419584:12345-0@lo:503: 00000100:00100000:2.0:1787572300.830395:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268419584:12345-0@lo:503: Request processed in 367us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.830403:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787572300.832302:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268419584:0@lo:503: 00000100:00100000:3.0:1787572300.833532:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8474:1874405268419712:0@lo:502: 00000100:00100000:3.0:1787572300.834073:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.834129:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1de230000 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.834283:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268419712 00000100:00100000:0.0:1787572300.834294:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268419712 00000100:00100000:0.0:1787572300.834360:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787572300.834372:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:8474:x1874405268419712:12345-0@lo:502: 00000100:00100000:0.0:1787572300.834742:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+14:8474:x1874405268419712:12345-0@lo:502: Request processed in 371us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.834752:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787572300.835010:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8474:1874405268419712:0@lo:502: 00000020:01000000:2.0:1787572300.835053:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787572300.835072:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572300.835075:0:8474:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787572300.835083:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787572300.835125:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8474:1874405268419840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572300.835184:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.835222:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f43d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787572300.835402:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268419840 00000100:00100000:1.0:1787572300.835409:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268419840 00000100:00100000:1.0:1787572300.835462:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787572300.835472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:8474:x1874405268419840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572300.835720:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+14:8474:x1874405268419840:12345-0@lo:502:llog_process_th.0 Request processed in 239us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572300.835736:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787572300.836170:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8474:1874405268419840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787572300.836205:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572300.836213:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572300.836215:0:8474:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787572300.836219:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787572300.836986:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787572300.837041:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787572300.837058:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572300.837072:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572300.837085:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787572300.837089:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1cebea800 from 39 10000000:01000000:3.0:1787572300.837092:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787572300.837141:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572300.837150:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572300.837543:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572300.837703:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268419968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.838321:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.838381:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f43d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787572300.838492:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268419968 00000100:00100000:1.0:1787572300.838503:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268419968 00000100:00100000:1.0:1787572300.838569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787572300.838581:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:5839:x1874405268419968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787572300.838611:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572300.838662:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43630d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436306 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.838693:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43630d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436306 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.838704:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43630d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436306 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.838723:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c9600, rc 0) 00000100:00100000:1.0:1787572300.839433:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268419968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 853us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572300.839442:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787572300.839540:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268419968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572300.839563:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.839575:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572300.839720:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.845427:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.848287:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f43d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787572300.849058:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268420096 00000100:00100000:3.0:1787572300.849074:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268420096 00000100:00100000:3.0:1787572300.849206:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787572300.849221:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268420096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.849741:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268420096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 522us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572300.849751:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787572300.849947:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.850033:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.850096:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572300.851684:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.852178:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268420224 00000100:00100000:2.0:1787572300.852191:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268420224 00000100:00100000:2.0:1787572300.852261:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787572300.852274:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268420224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.852630:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268420224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 356us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.852663:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787572300.853184:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.854534:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8475:1874405268420352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572300.856209:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572300.856315:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.856430:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268420352 00000100:00100000:2.0:1787572300.856443:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268420352 00000100:00100000:2.0:1787572300.856508:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787572300.856521:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:8475:x1874405268420352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572300.859081:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:8475:x1874405268420352:12345-0@lo:502:llog_process_th.0 Request processed in 2550us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.859100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787572300.859328:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8475:1874405268420352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572300.859499:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8475:1874405268420480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572300.859570:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.860041:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f43d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.860190:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268420480 00000100:00100000:0.0:1787572300.860210:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268420480 00000100:00100000:0.0:1787572300.860273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787572300.860284:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:8475:x1874405268420480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572300.863557:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+15:8475:x1874405268420480:12345-0@lo:502:llog_process_th.0 Request processed in 3258us (3972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.863575:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787572300.864074:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8475:1874405268420480:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787572300.864132:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787572300.864942:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787572300.865048:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787572300.865063:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.865077:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572300.865089:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787572300.865093:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787572300.865097:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787572300.865149:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.865158:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.865171:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572300.865199:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.865274:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.865601:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572300.865932:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572300.876082:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268420608 00000100:00100000:1.0:1787572300.876103:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268420608 00000100:00100000:1.0:1787572300.876202:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244277504 00000100:00100000:1.0:1787572300.876206:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244277504 00000100:00100000:1.0:1787572300.876231:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787572300.876243:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+15:5839:x1874405268420608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787572300.876285:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572300.876310:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f43631b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436314 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.876347:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f43631b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436314 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.876361:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f43631b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436314 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.876373:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8600, rc 0) 00000100:00100000:1.0:1787572300.876486:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268420608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (11212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572300.876493:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787572300.876530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 147 00000100:00100000:1.0:1787572300.876536:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+8:5597:x1874405244277504:12345-192.168.204.55@tcp:101: 00010000:00010000:1.0:1787572300.876544:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572300.876551:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c9200/0x9fe530ef4f436322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db8a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.876566:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c9200/0x9fe530ef4f436322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8a1 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.876574:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c9200/0x9fe530ef4f436322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8a1 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.876581:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c9200, rc 0) 00000100:00100000:1.0:1787572300.876621:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+9:5597:x1874405244277504:12345-192.168.204.55@tcp:101: Request processed in 85us (11025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572300.876650:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 147 00000100:00100000:3.0:1787572300.877316:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572300.877346:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572300.877367:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572300.877474:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.877529:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.877555:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268420736 00000100:00100000:2.0:1787572300.877563:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268420736 00000100:00100000:3.0:1787572300.877584:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c31af180 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.877684:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787572300.877694:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268420736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.878374:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268420736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 677us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572300.878385:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787572300.878413:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.878476:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.878530:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.882246:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f43d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.882371:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268420864 00000100:00100000:0.0:1787572300.882384:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268420864 00000100:00100000:0.0:1787572300.882456:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787572300.882469:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268420864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.883983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572300.884009:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244277632 00000100:00100000:3.0:1787572300.884018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244277632 00000100:00100000:3.0:1787572300.884059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 150 00000100:00100000:3.0:1787572300.884069:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+9:5597:x1874405244277632:12345-192.168.204.55@tcp:501: 00000100:00100000:0.0:1787572300.884567:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268420864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2096us (6032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.884578:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787572300.884627:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+9:5597:x1874405244277632:12345-192.168.204.55@tcp:501: Request processed in 557us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572300.884660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 150 00000100:00100000:2.0:1787572300.885485:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268420864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.889800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572300.889923:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244277760 00000100:00100000:1.0:1787572300.889939:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244277760 00000100:00100000:1.0:1787572300.890012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 151 00000100:00100000:1.0:1787572300.890025:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+9:5597:x1874405244277760:12345-192.168.204.55@tcp:503: 00000100:00100000:1.0:1787572300.890921:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+9:5597:x1874405244277760:12345-192.168.204.55@tcp:503: Request processed in 893us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572300.890935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 151 00000100:00100000:1.0:1787572300.893061:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8476:1874405268420992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572300.893287:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572300.893346:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e12ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572300.893358:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268420992 00000100:00100000:3.0:1787572300.893369:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268420992 00000100:00100000:3.0:1787572300.893436:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787572300.893449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:8476:x1874405268420992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572300.893773:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:8476:x1874405268420992:12345-0@lo:502:llog_process_th.0 Request processed in 326us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572300.893783:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787572300.893818:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8476:1874405268420992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787572300.893857:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572300.893868:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572300.893871:0:8476:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787572300.893877:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787572300.893898:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8476:1874405268421120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572300.893933:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572300.893964:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1b5f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.894016:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268421120 00000100:00100000:0.0:1787572300.894021:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268421120 00000100:00100000:0.0:1787572300.894056:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787572300.894065:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:8476:x1874405268421120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572300.894340:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:8476:x1874405268421120:12345-0@lo:502:llog_process_th.0 Request processed in 276us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.894347:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787572300.894552:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8476:1874405268421120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787572300.894583:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572300.894588:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572300.894590:0:8476:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787572300.894595:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000100:00100000:1.0:1787572300.898071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572300.898407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244277888 00000100:00100000:3.0:1787572300.898421:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244277888 00000100:00100000:3.0:1787572300.898500:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 154 00000100:00100000:3.0:1787572300.898513:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+9:6069:x1874405244277888:12345-192.168.204.55@tcp:502: 00000100:00100000:3.0:1787572300.898937:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+9:6069:x1874405244277888:12345-192.168.204.55@tcp:502: Request processed in 425us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572300.898946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 154 00000020:01000000:0.0:1787572300.901516:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787572300.901567:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787572300.901583:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.901598:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572300.901612:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787572300.901615:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1c4a88000 from 39 10000000:01000000:0.0:1787572300.901618:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787572300.901700:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.901721:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.901761:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572300.901794:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268421248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.902017:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572300.902071:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787572300.902368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572300.902506:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268421248 00000100:00100000:0.0:1787572300.902515:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268421248 00000100:00100000:0.0:1787572300.902614:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244278016 00000100:00100000:0.0:1787572300.902618:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244278016 00000100:00100000:2.0:1787572300.902977:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787572300.902993:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268421248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572300.903015:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572300.903037:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d206278200/0x9fe530ef4f436330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436329 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.903072:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206278200/0x9fe530ef4f436330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436329 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.903084:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d206278200/0x9fe530ef4f436330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436329 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.903094:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206278200, rc 0) 00000100:00100000:2.0:1787572300.903154:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268421248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.903173:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787572300.903213:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 156 00000100:00100000:2.0:1787572300.903220:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+9:6069:x1874405244278016:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787572300.903540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+9:6069:x1874405244278016:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 318us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.903548:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 156 00000100:00100000:3.0:1787572300.903813:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268421248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572300.903845:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572300.903858:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572300.903948:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268421376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.903986:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.904022:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c60f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.904198:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268421376 00000100:00100000:2.0:1787572300.904204:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268421376 00000100:00100000:2.0:1787572300.904244:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787572300.904251:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268421376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.904536:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268421376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.904545:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787572300.904758:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268421376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.904799:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268421504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.904860:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.904891:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c60f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.905046:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268421504 00000100:00100000:2.0:1787572300.905051:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268421504 00000100:00100000:2.0:1787572300.905077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787572300.905085:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268421504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.905270:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268421504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.905277:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787572300.905417:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268421504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.905924:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8477:1874405268421632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572300.905973:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.906019:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c60f1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.906131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268421632 00000100:00100000:2.0:1787572300.906138:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268421632 00000100:00100000:2.0:1787572300.906237:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787572300.906247:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:8477:x1874405268421632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572300.906474:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:8477:x1874405268421632:12345-0@lo:502:llog_process_th.0 Request processed in 229us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.906482:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787572300.906572:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8477:1874405268421632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572300.906624:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8477:1874405268421760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572300.906690:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.906718:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e05b9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.907043:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268421760 00000100:00100000:2.0:1787572300.907049:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268421760 00000100:00100000:2.0:1787572300.907077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787572300.907085:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:8477:x1874405268421760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572300.907339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:8477:x1874405268421760:12345-0@lo:502:llog_process_th.0 Request processed in 254us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.907347:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787572300.907448:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8477:1874405268421760:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787572300.907477:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787572300.907796:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787572300.908316:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787572300.908333:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.908347:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572300.908360:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787572300.908364:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787572300.908367:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787572300.908412:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.908421:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.908432:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572300.908456:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268421888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.908511:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.908559:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f43d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.908583:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268421888 00000100:00100000:2.0:1787572300.908588:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268421888 00000100:00100000:2.0:1787572300.908625:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787572300.908671:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268421888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572300.908684:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572300.908701:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d206278c00/0x9fe530ef4f43633e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436337 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.909309:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d206278c00/0x9fe530ef4f43633e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436337 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.909322:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d206278c00/0x9fe530ef4f43633e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436337 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.909332:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d206278c00, rc 0) 00000100:00100000:2.0:1787572300.909441:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268421888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 807us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.909449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787572300.911563:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268421888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572300.911599:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572300.911614:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572300.912133:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268422016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572300.912350:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572300.912439:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e05b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.912580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268422016 00000100:00100000:0.0:1787572300.912589:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268422016 00000100:00100000:0.0:1787572300.912673:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787572300.912687:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268422016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.913089:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268422016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.913098:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787572300.913455:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268422016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787572300.913510:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268422144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572300.913563:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572300.913600:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e12ca900 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.914049:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268422144 00000100:00100000:0.0:1787572300.914058:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268422144 00000100:00100000:0.0:1787572300.914096:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787572300.914105:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268422144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.914437:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268422144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.914444:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787572300.914534:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268422144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572300.918540:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8478:1874405268422272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572300.918722:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572300.918777:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d07e1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572300.918861:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268422272 00000100:00100000:2.0:1787572300.918872:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268422272 00000100:00100000:2.0:1787572300.918931:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787572300.918942:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8478:x1874405268422272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572300.919267:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8478:x1874405268422272:12345-0@lo:502:llog_process_th.0 Request processed in 325us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572300.919275:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787572300.919552:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8478:1874405268422272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572300.919590:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572300.919607:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572300.919610:0:8478:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787572300.919616:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787572300.919664:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8478:1874405268422400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572300.919702:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572300.919744:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268422400 00000100:00100000:0.0:1787572300.919748:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268422400 00000100:00100000:0.0:1787572300.919773:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787572300.919780:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8478:x1874405268422400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572300.919933:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8478:x1874405268422400:12345-0@lo:502:llog_process_th.0 Request processed in 152us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.919940:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787572300.919979:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.919991:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8478:1874405268422400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572300.920009:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572300.920013:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572300.920015:0:8478:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787572300.920018:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787572300.920554:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787572300.920579:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787572300.920593:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.920606:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572300.920617:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787572300.920621:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d1d5ed4d28 from 1 10000000:01000000:2.0:1787572300.920659:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787572300.920694:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.920702:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.920723:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572300.920741:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268422528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.920781:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.920807:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f43d39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.921136:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268422528 00000100:00100000:0.0:1787572300.921143:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268422528 00000100:00100000:0.0:1787572300.921314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787572300.921324:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268422528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572300.921337:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572300.921353:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f43634c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436345 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.921379:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f43634c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436345 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.921403:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f43634c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436345 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572300.921414:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30400, rc 0) 00000100:00100000:0.0:1787572300.921459:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268422528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572300.921465:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787572300.921578:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268422528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572300.921594:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43634c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.921605:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43634c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572300.921720:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268422656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572300.921751:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572300.921783:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f43d39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572300.921913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268422656 00000100:00100000:0.0:1787572300.921918:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268422656 00000100:00100000:0.0:1787572300.921988:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787572300.921995:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268422656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.922333:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268422656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (581us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787572300.922341:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787572300.922397:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268422656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787572300.922428:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787572300.922435:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43634c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572300.922455:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43634c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572300.924062:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572300.927941:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244278144 00000100:00100000:1.0:1787572300.927965:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244278144 00000100:00100000:1.0:1787572300.928057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 168 00000100:00100000:1.0:1787572300.928068:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+9:5597:x1874405244278144:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787572300.928091:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572300.928114:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c8800/0x9fe530ef4f436353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db8a8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.928269:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c8800/0x9fe530ef4f436353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8a8 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.928287:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c8800/0x9fe530ef4f436353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8a8 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572300.928299:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8800, rc 0) 00000100:00100000:1.0:1787572300.928393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5597:x1874405244278144:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 327us (4344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572300.928401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 168 00000100:00100000:1.0:1787572300.937484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572300.939140:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244278272 00000100:00100000:0.0:1787572300.939281:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244278272 00000100:00100000:0.0:1787572300.939426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 169 00000100:00100000:0.0:1787572300.939440:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5597:x1874405244278272:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572300.939995:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5597:x1874405244278272:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 555us (2523us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787572300.940006:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 169 00010000:00010000:1.0:1787572301.615940:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572302.318944:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268422912:0@lo:400:kworker.0 00000100:00100000:2.0:1787572302.319023:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572302.319069:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268423424:0@lo:400:kworker.0 00000100:00100000:2.0:1787572302.319095:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572302.319140:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787572302.319147:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268422784:0@lo:400:kworker.0 00000100:00100000:2.0:1787572302.319174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572302.319192:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268423296:0@lo:400:kworker.0 00000100:00100000:2.0:1787572302.319213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572302.319240:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268423424 00000100:00100000:2.0:1787572302.319246:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268423424 00000100:00100000:2.0:1787572302.319304:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787572302.319314:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268423424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572302.319365:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268423424:12345-0@lo:400:kworker.0 Request processed in 52us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572302.319371:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787572302.319407:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787572302.319434:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd15c00 x1874405268423424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572302.319456:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268423424:0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.319717:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268423040:0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.319749:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572302.319773:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572302.319778:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268423168:0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.319812:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572302.319838:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268422912 00000100:00100000:3.0:1787572302.319842:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268422912 00000100:00100000:3.0:1787572302.319868:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268423296 00000100:00100000:3.0:1787572302.319882:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268423296 00000100:00100000:3.0:1787572302.319905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268423040 00000100:00100000:3.0:1787572302.319907:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268423040 00000100:00100000:3.0:1787572302.319924:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787572302.319929:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268422912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.319967:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268422912:12345-0@lo:400:kworker.0 Request processed in 37us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572302.319974:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787572302.319985:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787572302.319992:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268423296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.320017:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268423296:12345-0@lo:400:kworker.0 Request processed in 26us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572302.320022:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787572302.320035:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787572302.320040:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268423040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.320071:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268423040:12345-0@lo:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572302.320078:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787572302.320096:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268422784 00000100:00100000:3.0:1787572302.320099:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268422784 00000100:00100000:3.0:1787572302.320121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787572302.320192:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268422784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.320224:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268422784:12345-0@lo:400:kworker.0 Request processed in 35us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572302.320230:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:3.0:1787572302.320256:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572302.320275:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268423040:0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.320305:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268422784:0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.320314:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268423296:0@lo:400:kworker.0 00000100:00100000:3.0:1787572302.320323:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268422912:0@lo:400:kworker.0 00000100:00100000:1.0:1787572302.321517:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268423168 00000100:00100000:1.0:1787572302.321528:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268423168 00000100:00100000:1.0:1787572302.321579:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787572302.321587:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268423168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572302.321691:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268423168:12345-0@lo:400:kworker.0 Request processed in 105us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572302.321698:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787572302.321721:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787572302.324046:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd16a00 x1874405268423168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572302.324064:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268423168:0@lo:400:kworker.0 00000020:00000080:3.0:1787572302.345979:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe34e35d80 20000000:00000080:3.0:1787572302.345997:0:8515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d1fc8dc400 uarg=0000000000000000 20000000:01000000:3.0:1787572302.346046:0:8515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787572302.346052:0:8515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787572302.346056:0:8515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787572302.347176:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787572302.348199:0:8515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787572302.352935:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787572302.352991:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787572302.353045:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787572302.353063:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787572302.353082:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353100:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c1463800/0x9fe530ef4f4360cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353107:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353114:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353123:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353145:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353198:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353213:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 9 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572302.353228:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874405268423552:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572302.353382:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353400:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 18 pid: 5836 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572302.353410:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874405268423680:0@lo:104: 00000100:00100000:3.0:1787572302.353460:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787572302.353503:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353511:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 18 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572302.353519:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874405268423808:0@lo:104: 00000100:00100000:3.0:1787572302.353543:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572302.353577:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787572302.353590:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268423680 00000100:00100000:3.0:1787572302.353596:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268423680 00000100:00100000:3.0:1787572302.353664:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268423808 00000100:00100000:3.0:1787572302.353668:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268423808 00000100:00100000:3.0:1787572302.353709:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787572302.353717:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+4:8515:x1874405268423680:12345-0@lo:104: 00010000:00010000:3.0:1787572302.353730:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.353789:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787572302.353983:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+4:8515:x1874405268423680:12345-0@lo:104: Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572302.353992:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787572302.354010:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787572302.354017:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:8515:x1874405268423808:12345-0@lo:104: 00010000:00010000:3.0:1787572302.354025:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.354325:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787572302.354332:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:8515:x1874405268423808:12345-0@lo:104: Request processed in 315us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572302.354338:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787572302.355058:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787572302.355067:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355076:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572302.355080:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355090:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572302.355096:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572302.355102:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787572302.355146:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355153:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572302.355174:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355195:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f4361f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4361fc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355209:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572302.355213:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355219:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462000 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572302.355222:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355229:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572302.355235:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572302.355240:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787572302.355255:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355260:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572302.355266:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355273:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f43612a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436131 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355282:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572302.355290:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572302.355292:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572302.355309:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268423936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572302.355352:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572302.355387:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572302.355393:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268424064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572302.355415:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572302.355447:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268423936 00000100:00100000:1.0:1787572302.355452:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268423936 00010000:00010000:1.0:1787572302.355475:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 19 pid: 5836 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572302.355495:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268424064 00000100:00100000:1.0:1787572302.355499:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268424064 00010000:00010000:1.0:1787572302.355510:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 20 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572302.355528:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787572302.355535:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+20:3310:x1874405268423936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572302.355547:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572302.355552:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 20 pid: 5836 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355561:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 20 pid: 5836 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355577:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572302.355606:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+20:3310:x1874405268423936:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572302.355612:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787572302.355799:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787572302.355808:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268424064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572302.355816:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572302.355821:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 19 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355829:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 19 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.355839:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572302.355875:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268424064:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572302.355881:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787572302.355923:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268424064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572302.355931:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268423936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787572302.356343:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572302.356811:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c1463800/0x9fe530ef4f4360cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.356825:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c1463800/0x9fe530ef4f4360cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 18 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572302.356836:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874405268424192:0@lo:104: 00000100:00100000:3.0:1787572302.356870:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572302.356897:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e05b9180 going to sleep for 11 seconds 00010000:00010000:3.0:1787572302.356914:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c1463e00/0x9fe530ef4f4361fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4361f5 expref: 18 pid: 5836 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572302.356936:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874405268423680:0@lo:104: 00010000:00010000:3.0:1787572302.356948:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c0031800/0x9fe530ef4f436131 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43612a expref: 17 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572302.356957:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874405268423808:0@lo:104: 00000100:00100000:1.0:1787572302.357207:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268424192 00000100:00100000:1.0:1787572302.357214:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268424192 00000100:00100000:1.0:1787572302.357252:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787572302.357260:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:8515:x1874405268424192:12345-0@lo:104: 00010000:00010000:1.0:1787572302.357270:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572302.357324:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787572302.357430:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:8515:x1874405268424192:12345-0@lo:104: Request processed in 71us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572302.357437:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787572302.357949:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572302.357964:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.357973:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9400 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:2.0:1787572302.357976:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.357985:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787572302.357993:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572302.357999:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787572302.358029:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.358035:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787572302.358054:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.358060:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4360c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4360cf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.358074:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572302.358076:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572302.358077:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572302.358088:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268424320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787572302.358120:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572302.358183:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268424320 00000100:00100000:2.0:1787572302.358188:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268424320 00010000:00010000:2.0:1787572302.358214:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c1463800/0x9fe530ef4f4360cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 17 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572302.358238:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787572302.358244:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:3312:x1874405268424320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572302.358254:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572302.358258:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c1463800/0x9fe530ef4f4360cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 17 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.358267:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c1463800/0x9fe530ef4f4360cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 17 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.358281:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572302.358310:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:3312:x1874405268424320:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572302.358316:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787572302.358345:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268424320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572302.359209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572302.359457:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244278400 00000100:00100000:2.0:1787572302.359464:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244278400 00010000:00010000:2.0:1787572302.359488:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 10 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572302.359519:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:2.0:1787572302.359528:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46025283-1dc6-4449-aad9-047e59682663+10:2353:x1874405244278400:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572302.359538:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572302.359543:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 10 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359554:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 10 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359574:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359582:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359595:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359601:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359607:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359613:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359618:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572302.359622:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359629:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359672:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.359690:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572302.359731:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46025283-1dc6-4449-aad9-047e59682663+10:2353:x1874405244278400:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 204us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572302.359748:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00010000:00010000:2.0:1787572302.361172:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a30a00/0x9fe530ef4f4362b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db870 expref: 9 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572302.361191:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874405268423552:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572302.361206:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c1463800/0x9fe530ef4f4360cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4360c8 expref: 16 pid: 5835 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572302.361215:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874405268424192:0@lo:104: 00010000:00010000:2.0:1787572302.361250:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.361261:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.361268:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572302.361274:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f43635a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572302.639907:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572302.830923:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268424448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572302.830996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572302.831244:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268424448 00000100:00100000:2.0:1787572302.831253:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268424448 00000100:00100000:2.0:1787572302.831310:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787572302.831491:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268424448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572302.831527:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572302.831585:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268424448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 265us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572302.831610:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787572302.831715:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd15c00 x1874405268424448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572302.831735:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268424448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572303.350802:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268424576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572303.350886:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.352272:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268424576 00000100:00100000:0.0:1787572303.352283:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268424576 00000100:00100000:0.0:1787572303.352337:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787572303.352347:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268424576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572303.352395:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572303.354979:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268424576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2623us (4083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.354994:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787572303.356017:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbce7100 x1874405268424576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572303.356049:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268424576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787572303.664914:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787572303.861914:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787572303.861922:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1d0ba8000 from 4 10000000:01000000:0.0:1787572303.861927:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787572303.861978:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.861991:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.862004:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572303.862031:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268424704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.862112:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.862172:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d0b1d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787572303.862319:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268424704 00000100:00100000:3.0:1787572303.862329:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268424704 00000100:00100000:3.0:1787572303.862386:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787572303.862397:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268424704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572303.862413:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572303.862428:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572303.862450:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572303.862461:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572303.862471:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea800, rc 0) 00000100:00100000:3.0:1787572303.862520:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268424704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572303.862527:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787572303.862681:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268424704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572303.862698:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.862707:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572303.862763:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268424832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.862790:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.862827:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d0b1d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787572303.862934:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268424832 00000100:00100000:3.0:1787572303.862939:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268424832 00000100:00100000:3.0:1787572303.863066:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787572303.863075:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268424832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572303.863344:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268424832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572303.863352:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787572303.863496:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268424832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.863529:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268424960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.863566:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.863595:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d0b1d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787572303.863741:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268424960 00000100:00100000:3.0:1787572303.863746:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268424960 00000100:00100000:3.0:1787572303.863770:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787572303.863777:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268424960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572303.863915:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268424960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572303.863922:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787572303.863999:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268424960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.871071:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8575:1874405268425088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.871257:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.871300:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268425088 00000100:00100000:0.0:1787572303.871307:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268425088 00000100:00100000:0.0:1787572303.871352:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787572303.871362:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:8575:x1874405268425088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.871562:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:8575:x1874405268425088:12345-0@lo:502:llog_process_th.0 Request processed in 201us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.871570:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787572303.871619:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d0b1d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.872185:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8575:1874405268425088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572303.872218:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572303.872230:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572303.872233:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787572303.872240:0:8575:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d1d0ba8000 00000020:00000080:0.0:1787572303.872242:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787572303.877774:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8575:1874405268425216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572303.877857:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572303.877907:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.881548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268425216 00000100:00100000:0.0:1787572303.881566:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268425216 00000100:00100000:0.0:1787572303.881624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787572303.881657:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:8575:x1874405268425216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.889277:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:8575:x1874405268425216:12345-0@lo:502:llog_process_th.0 Request processed in 7607us (11383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.889294:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787572303.893996:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8575:1874405268425216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787572303.894045:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572303.894057:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572303.894060:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787572303.894065:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787572303.900212:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787572303.900240:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787572303.900252:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572303.900265:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572303.900276:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787572303.900279:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1cebea800 from 4 10000000:01000000:2.0:1787572303.900281:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787572303.900319:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572303.900327:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572303.900338:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572303.900362:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268425344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572303.900437:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572303.900479:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.900569:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268425344 00000100:00100000:0.0:1787572303.900576:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268425344 00000100:00100000:0.0:1787572303.900625:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787572303.900660:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268425344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572303.900674:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572303.900688:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43636f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.900709:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.900719:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.900727:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a31e00, rc 0) 00000100:00100000:3.0:1787572303.904270:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268425344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572303.904302:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572303.904315:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572303.904397:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268425472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.904939:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268425344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.904952:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787572303.912093:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572303.912137:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fb8a6600 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.917682:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268425472 00000100:00100000:0.0:1787572303.917696:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268425472 00000100:00100000:0.0:1787572303.917747:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787572303.917757:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268425472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.918058:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268425472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (5971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.918077:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787572303.927773:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268425472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787572303.927845:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268425600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572303.927917:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572303.927963:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.932752:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268425600 00000100:00100000:0.0:1787572303.932766:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268425600 00000100:00100000:0.0:1787572303.932817:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787572303.932827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268425600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.933081:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268425600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.933090:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787572303.933818:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268425600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.943844:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8583:1874405268425728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.943941:0:8583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.943983:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268425728 00000100:00100000:0.0:1787572303.943990:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268425728 00000100:00100000:0.0:1787572303.944031:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787572303.944041:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8583:x1874405268425728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.945662:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8583:x1874405268425728:12345-0@lo:502:llog_process_th.0 Request processed in 1591us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.945674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787572303.945741:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fb0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.945767:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8583:1874405268425728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572303.945803:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572303.945814:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572303.945817:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787572303.945824:0:8583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d1cebea800 00000020:00000080:0.0:1787572303.945827:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787572303.946283:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8583:1874405268425856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.946329:0:8583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.946371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268425856 00000100:00100000:0.0:1787572303.946378:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268425856 00000100:00100000:0.0:1787572303.948306:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787572303.948328:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8583:x1874405268425856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.948906:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:8583:x1874405268425856:12345-0@lo:502:llog_process_th.0 Request processed in 585us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.948916:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787572303.949489:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b24d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.949519:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8583:1874405268425856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572303.949553:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572303.949561:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572303.949564:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787572303.949569:0:8583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787572303.949667:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787572303.949687:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787572303.949698:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.949710:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572303.949721:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787572303.949724:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1c4a88000 from 4 10000000:01000000:0.0:1787572303.949727:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787572303.949757:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.949779:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.949791:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572303.949815:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268425984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.949863:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.949885:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b24d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.949903:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268425984 00000100:00100000:0.0:1787572303.949911:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268425984 00000100:00100000:0.0:1787572303.949954:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787572303.949963:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268425984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572303.949976:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572303.949988:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43637d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.950012:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.950022:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.950032:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a31600, rc 0) 00000100:00100000:0.0:1787572303.950061:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268425984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.950067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787572303.951301:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268425984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572303.951324:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.951337:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572303.952387:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268426112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.952531:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.952564:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b24d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.952594:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268426112 00000100:00100000:0.0:1787572303.952602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268426112 00000100:00100000:0.0:1787572303.952663:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787572303.952672:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268426112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.952914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268426112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.952922:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787572303.952966:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268426112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.952994:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268426240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.953031:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.953044:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b24d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.953057:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268426240 00000100:00100000:0.0:1787572303.953060:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268426240 00000100:00100000:0.0:1787572303.953080:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787572303.953086:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268426240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.954595:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268426240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1502us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.954611:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787572303.954728:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268426240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572303.954919:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8585:1874405268426368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.954955:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.954977:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268426368 00000100:00100000:0.0:1787572303.954982:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268426368 00000100:00100000:0.0:1787572303.955009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787572303.955016:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:8585:x1874405268426368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.956063:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:8585:x1874405268426368:12345-0@lo:502:llog_process_th.0 Request processed in 1043us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.956074:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787572303.956530:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b24d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.956552:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8585:1874405268426368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572303.956583:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572303.956593:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572303.956595:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787572303.956602:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d1c4a88000 00000020:00000080:0.0:1787572303.956604:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787572303.958201:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8585:1874405268426496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.958278:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572303.958314:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268426496 00000100:00100000:0.0:1787572303.958322:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268426496 00000100:00100000:0.0:1787572303.958381:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787572303.958390:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:8585:x1874405268426496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572303.958918:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:8585:x1874405268426496:12345-0@lo:502:llog_process_th.0 Request processed in 528us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572303.958932:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787572303.959501:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c518a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787572303.959525:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:8585:1874405268426496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572303.959557:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572303.959565:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572303.959568:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787572303.959572:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787572303.959630:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787572303.959676:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787572303.959687:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572303.959699:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572304.135055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572304.135208:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244278528 00000100:00100000:2.0:1787572304.135218:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244278528 00000100:00100000:2.0:1787572304.135274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 186 00000100:00100000:2.0:1787572304.135286:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+9:5597:x1874405244278528:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572304.135319:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572304.135338:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db8af expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572304.135365:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572304.135376:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572304.135385:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276c00, rc 0) 00000100:00100000:2.0:1787572304.135444:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:5597:x1874405244278528:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 160us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572304.135451:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 186 00000100:00100000:3.0:1787572304.138784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572304.138911:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244278656 00000100:00100000:0.0:1787572304.138924:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244278656 00000100:00100000:0.0:1787572304.138991:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 187 00000100:00100000:0.0:1787572304.139002:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:5597:x1874405244278656:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572304.139321:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:5597:x1874405244278656:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 321us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572304.139330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 187 00000100:00100000:1.0:1787572304.142500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572304.142936:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244278784 00000100:00100000:2.0:1787572304.142948:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244278784 00000100:00100000:2.0:1787572304.143103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00100000:2.0:1787572304.143116:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5597:x1874405244278784:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572304.143354:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:5597:x1874405244278784:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 241us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572304.143363:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00100000:3.0:1787572304.150114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572304.152090:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244278912 00000100:00100000:1.0:1787572304.152105:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244278912 00000100:00100000:1.0:1787572304.152169:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 189 00000100:00100000:1.0:1787572304.152180:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:6133:x1874405244278912:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787572304.152478:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:6133:x1874405244278912:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 299us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572304.152495:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 189 00000100:00100000:3.0:1787572304.164441:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572304.164592:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244279040 00000100:00100000:1.0:1787572304.164604:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244279040 00000100:00100000:1.0:1787572304.164693:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 190 00000100:00100000:1.0:1787572304.164705:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:6133:x1874405244279040:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787572304.164947:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:6133:x1874405244279040:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 244us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572304.164955:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 190 00000100:00100000:3.0:1787572304.195342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572304.195378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572304.195477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244279168 00000100:00100000:0.0:1787572304.195487:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244279168 00000100:00100000:0.0:1787572304.195564:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:0.0:1787572304.195582:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244279168:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572304.195706:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244279168:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 132us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572304.195714:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00080000:0.0:1787572304.195760:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572304.195918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572304.198671:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244279296 00000100:00100000:2.0:1787572304.198692:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244279296 00000100:00100000:2.0:1787572304.198767:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244279424 00000100:00100000:2.0:1787572304.198771:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244279424 00000100:00100000:2.0:1787572304.198796:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1787572304.198806:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244279296:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572304.198895:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244279296:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 90us (3516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572304.198903:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1787572304.198918:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:2.0:1787572304.198931:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2355:x1874405244279424:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572304.198953:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2355:x1874405244279424:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 29us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572304.198958:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00080000:3.0:1787572304.199379:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572304.199383:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787572304.691881:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572305.710965:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572306.741342:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572307.439620:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268426880:0@lo:400:kworker.0 00000100:00100000:3.0:1787572307.439715:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572307.439772:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787572307.439780:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268426752:0@lo:400:kworker.0 00000100:00100000:3.0:1787572307.439816:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572307.439841:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268427264:0@lo:400:kworker.0 00000100:00100000:3.0:1787572307.439867:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572307.440035:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268427008:0@lo:400:kworker.0 00000100:00100000:0.0:1787572307.440065:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572307.440093:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787572307.440098:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268426624:0@lo:400:kworker.0 00000100:00100000:0.0:1787572307.440124:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572307.440157:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268427136:0@lo:400:kworker.0 00000100:00100000:0.0:1787572307.440178:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572307.440291:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268426880 00000100:00100000:0.0:1787572307.440298:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268426880 00000100:00100000:0.0:1787572307.440351:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268426752 00000100:00100000:0.0:1787572307.440354:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268426752 00000100:00100000:0.0:1787572307.440367:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268427136 00000100:00100000:0.0:1787572307.440369:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268427136 00000100:00100000:0.0:1787572307.440388:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787572307.440395:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268426880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572307.440448:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268426880:12345-0@lo:400:kworker.0 Request processed in 53us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572307.440455:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787572307.440472:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787572307.440478:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572307.440505:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268426752:12345-0@lo:400:kworker.0 Request processed in 28us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572307.440524:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787572307.440537:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787572307.440542:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268427136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572307.440576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268427136:12345-0@lo:400:kworker.0 Request processed in 34us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572307.440593:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787572307.440611:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572307.440674:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268427136:0@lo:400:kworker.0 00000100:00100000:0.0:1787572307.440703:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268426752:0@lo:400:kworker.0 00000100:00100000:0.0:1787572307.440712:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268426880:0@lo:400:kworker.0 00000100:00100000:3.0:1787572307.440911:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268427264 00000100:00100000:3.0:1787572307.440916:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268427264 00000100:00100000:3.0:1787572307.440960:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268427008 00000100:00100000:3.0:1787572307.440963:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268427008 00000100:00100000:3.0:1787572307.440980:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787572307.440988:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268427264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572307.441024:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268427264:12345-0@lo:400:kworker.0 Request processed in 38us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572307.441030:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787572307.441042:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787572307.441049:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268427008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572307.441079:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268427008:12345-0@lo:400:kworker.0 Request processed in 31us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572307.441094:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787572307.441234:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268426624 00000100:00100000:2.0:1787572307.441239:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268426624 00000100:00100000:2.0:1787572307.441270:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787572307.441277:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268426624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572307.441311:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268426624:12345-0@lo:400:kworker.0 Request processed in 35us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572307.441316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:0.0:1787572307.441536:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572307.441539:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572307.441561:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268426624:0@lo:400:kworker.0 00010000:00080000:0.0:1787572307.441575:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d55880 x1874405268427008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572307.441596:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268427008:0@lo:400:kworker.0 00010000:00080000:0.0:1787572307.441626:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c5d54a80 x1874405268427264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572307.441669:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268427264:0@lo:400:kworker.0 00010000:00010000:1.0:1787572307.762569:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572307.955450:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268427392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572307.955520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572307.955608:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268427392 00000100:00100000:2.0:1787572307.955616:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268427392 00000100:00100000:2.0:1787572307.955682:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787572307.955692:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268427392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572307.955724:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572307.955768:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268427392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572307.955775:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787572307.955828:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd16d80 x1874405268427392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572307.955846:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268427392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572308.464105:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268427520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572308.464175:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572308.467206:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268427520 00000100:00100000:2.0:1787572308.467430:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268427520 00000100:00100000:2.0:1787572308.467500:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787572308.467513:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268427520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572308.467557:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572308.467692:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268427520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (3516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572308.467700:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787572308.468149:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e71880 x1874405268427520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572308.468180:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268427520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787572308.787594:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572309.317017:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572309.317103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572309.317135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572309.317163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572309.317197:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244279936 00000100:00100000:2.0:1787572309.317208:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244279936 00000100:00100000:2.0:1787572309.317265:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244279808 00000100:00100000:2.0:1787572309.317268:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244279808 00000100:00100000:2.0:1787572309.317289:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1787572309.317299:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244279936:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572309.317454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244279552 00000100:00100000:3.0:1787572309.317459:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244279552 00000100:00100000:3.0:1787572309.317492:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 192 00000100:00100000:3.0:1787572309.317499:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:2353:x1874405244279552:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572309.317613:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:2353:x1874405244279552:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 114us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572309.317621:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 192 00000100:00100000:2.0:1787572309.319169:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244279936:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 1868us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572309.319179:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1787572309.319206:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1787572309.319214:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244279808:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572309.319247:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244279808:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 36us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572309.319254:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00080000:2.0:1787572309.319275:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572309.319280:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572309.322019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244279680 00000100:00100000:0.0:1787572309.322034:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244279680 00000100:00100000:0.0:1787572309.322103:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:0.0:1787572309.322114:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244279680:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572309.322193:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244279680:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 80us (5185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572309.322201:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00080000:2.0:1787572309.325622:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787572309.695020:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787572309.808807:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572310.830991:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572311.859030:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572312.559225:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268428032:0@lo:400:kworker.0 00000100:00100000:0.0:1787572312.559304:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572312.559370:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787572312.559377:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268427648:0@lo:400:kworker.0 00000100:00100000:0.0:1787572312.559407:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572312.559426:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268428160:0@lo:400:kworker.0 00000100:00100000:0.0:1787572312.559449:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572312.559480:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268428032 00000100:00100000:0.0:1787572312.559498:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268428032 00000100:00100000:0.0:1787572312.559561:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787572312.559572:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268428032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572312.559625:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268428032:12345-0@lo:400:kworker.0 Request processed in 55us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572312.559631:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787572312.560059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268428160 00000100:00100000:0.0:1787572312.560065:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268428160 00000100:00100000:0.0:1787572312.560105:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787572312.560113:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268428160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572312.560147:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268428160:12345-0@lo:400:kworker.0 Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572312.560154:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787572312.560171:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787572312.560175:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572312.560206:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268428160:0@lo:400:kworker.0 00010000:00080000:0.0:1787572312.560220:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e72300 x1874405268428032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572312.560229:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268428032:0@lo:400:kworker.0 00000100:00100000:2.0:1787572312.560786:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268427776:0@lo:400:kworker.0 00000100:00100000:2.0:1787572312.560823:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572312.560848:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268428288:0@lo:400:kworker.0 00000100:00100000:2.0:1787572312.560871:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572312.560893:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572312.560900:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268427904:0@lo:400:kworker.0 00000100:00100000:2.0:1787572312.560922:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572312.560954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268427648 00000100:00100000:2.0:1787572312.560959:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268427648 00000100:00100000:2.0:1787572312.561066:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787572312.561256:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268427648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572312.561302:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268427648:12345-0@lo:400:kworker.0 Request processed in 51us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572312.561308:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787572312.561337:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268427776 00000100:00100000:2.0:1787572312.561340:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268427776 00000100:00100000:2.0:1787572312.561363:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268427904 00000100:00100000:2.0:1787572312.561366:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268427904 00000100:00100000:2.0:1787572312.561390:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787572312.561396:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268427776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572312.561443:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268427776:12345-0@lo:400:kworker.0 Request processed in 46us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572312.561449:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787572312.561462:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787572312.561468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268427904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572312.561506:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268427904:12345-0@lo:400:kworker.0 Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572312.561512:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787572312.561535:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268428288 00000100:00100000:2.0:1787572312.561539:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268428288 00000100:00100000:2.0:1787572312.561563:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787572312.561572:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268428288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572312.561602:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268428288:12345-0@lo:400:kworker.0 Request processed in 33us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572312.561608:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787572312.561629:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787572312.561658:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572312.562593:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268427648:0@lo:400:kworker.0 00000100:00100000:1.0:1787572312.562946:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268427904:0@lo:400:kworker.0 00000100:00100000:1.0:1787572312.562959:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268427776:0@lo:400:kworker.0 00010000:00080000:1.0:1787572312.563861:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e70700 x1874405268428288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572312.563874:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268428288:0@lo:400:kworker.0 00010000:00010000:1.0:1787572312.879054:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572313.070928:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268428416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572313.071004:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572313.071104:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268428416 00000100:00100000:1.0:1787572313.071113:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268428416 00000100:00100000:1.0:1787572313.071163:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787572313.071172:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268428416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787572313.071205:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572313.071247:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268428416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572313.071254:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787572313.071295:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd16a00 x1874405268428416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572313.071314:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268428416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572313.583752:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787572313.583775:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268428544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572313.583846:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572313.583907:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268428544 00000100:00100000:0.0:1787572313.583915:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268428544 00000100:00100000:0.0:1787572313.583961:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787572313.583970:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268428544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572313.584003:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572313.584045:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268428544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572313.584052:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787572313.584094:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e72300 x1874405268428544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572313.584129:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268428544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787572313.902932:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572314.444127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572314.444174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572314.444205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572314.444235:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244280320 00000100:00100000:2.0:1787572314.444245:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244280320 00000100:00100000:2.0:1787572314.444305:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:2.0:1787572314.444315:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2352:x1874405244280320:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:2.0:1787572314.444354:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4362c7 00000100:00080000:2.0:1787572314.444364:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf1e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787572314.444410:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787572314.446370:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+2:2352:x1874405244280320:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 2046us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572314.446385:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:2.0:1787572314.446430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244280064 00000100:00100000:2.0:1787572314.446439:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244280064 00000100:00100000:2.0:1787572314.446489:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 194 00000100:00100000:2.0:1787572314.446497:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244280064:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572314.446550:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244280064:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 54us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572314.446557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 194 00000100:00100000:2.0:1787572314.446590:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244280192 00000100:00100000:2.0:1787572314.446594:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244280192 00000100:00100000:2.0:1787572314.446651:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1787572314.446659:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244280192:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572314.446689:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244280192:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 32us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572314.446695:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00080000:2.0:1787572314.446713:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787572314.446719:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787572314.447859:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572314.450388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572314.450472:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244280448 00000100:00100000:0.0:1787572314.450482:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244280448 00000100:00100000:0.0:1787572314.450552:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:0.0:1787572314.450563:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2352:x1874405244280448:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:0.0:1787572314.450604:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4362ce 00000100:00080000:0.0:1787572314.450615:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf1d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787572314.450683:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1787572314.450988:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572314.451526:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+2:2352:x1874405244280448:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 961us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572314.451537:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00010000:00010000:0.0:1787572314.451590:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787572314.659882:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:2.0:1787572314.659904:0:6719:0:(genops.c:885:class_export_put()) final put ffff98d1cdf1b000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:2.0:1787572314.659941:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cdf1b000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd for lustre-OST0000 00000020:00000080:2.0:1787572314.659995:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1cdf1e000 for lustre-OST0000 00010000:00010000:1.0:1787572314.928813:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787572315.466531:0:9061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing yml_node 00010000:00010000:2.0:1787572315.950913:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572316.975858:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572317.682566:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268428672:0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.682677:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572317.683543:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268428928:0@lo:400:kworker.0 00000100:00100000:0.0:1787572317.683608:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572317.683661:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787572317.683668:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268428800:0@lo:400:kworker.0 00000100:00100000:0.0:1787572317.683693:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572317.683785:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268428928 00000100:00100000:1.0:1787572317.683794:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268428928 00000100:00100000:1.0:1787572317.683856:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268428800 00000100:00100000:1.0:1787572317.683859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268428800 00000100:00100000:1.0:1787572317.683881:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787572317.683891:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268428928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572317.683944:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268428928:12345-0@lo:400:kworker.0 Request processed in 56us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572317.683951:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787572317.683968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787572317.683975:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268428800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572317.684005:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268428800:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572317.684012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787572317.684016:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572317.684027:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268429056:0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.684060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572317.684091:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268429056 00000100:00100000:3.0:1787572317.684095:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268429056 00000100:00100000:3.0:1787572317.684125:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787572317.684147:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268429056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.684195:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268429056:12345-0@lo:400:kworker.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572317.684201:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787572317.684239:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd16a00 x1874405268429056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572317.684253:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268429056:0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.684506:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268428672 00000100:00100000:3.0:1787572317.684511:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268428672 00000100:00100000:1.0:1787572317.684524:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268428800:0@lo:400:kworker.0 00000100:00100000:1.0:1787572317.684542:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268428928:0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.684553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787572317.684564:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268428672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.684613:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268428672:12345-0@lo:400:kworker.0 Request processed in 52us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572317.684619:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1787572317.684624:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787572317.684630:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572317.684705:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268428672:0@lo:400:kworker.0 00000100:00100000:2.0:1787572317.685155:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572317.685165:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268429312:0@lo:400:kworker.0 00000100:00100000:2.0:1787572317.685195:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572317.686000:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268429184:0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.686040:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572317.686084:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268429184 00000100:00100000:3.0:1787572317.686089:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268429184 00000100:00100000:3.0:1787572317.686138:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787572317.686563:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572317.686572:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268429184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.686630:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268429184:12345-0@lo:400:kworker.0 Request processed in 484us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572317.686732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787572317.686777:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268429184:0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.688820:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268429312 00000100:00100000:3.0:1787572317.688833:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268429312 00000100:00100000:3.0:1787572317.688891:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787572317.688902:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268429312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572317.688976:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268429312:12345-0@lo:400:kworker.0 Request processed in 77us (3779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572317.688984:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787572317.689014:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787572317.690427:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd14380 x1874405268429312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572317.690445:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268429312:0@lo:400:kworker.0 00000001:00100000:2.0:1787572317.724814:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:2.0:1787572317.724823:0:7653:0:(genops.c:885:class_export_put()) final put ffff98d1cdf19000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:3.0:1787572317.725017:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cdf19000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd for lustre-OST0001 00000020:00000080:3.0:1787572317.725181:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1cdf1d800 for lustre-OST0001 00010000:00010000:2.0:1787572317.998811:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572318.191478:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268429440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572318.191564:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572318.191744:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268429440 00000100:00100000:1.0:1787572318.191754:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268429440 00000100:00100000:1.0:1787572318.191823:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787572318.191833:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268429440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787572318.191877:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572318.191935:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268429440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572318.191942:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787572318.192142:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd14380 x1874405268429440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572318.192162:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268429440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572318.707661:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268429568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572318.707741:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572318.708299:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268429568 00000100:00100000:0.0:1787572318.708308:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268429568 00000100:00100000:0.0:1787572318.708372:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787572318.708392:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268429568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572318.708428:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572318.708484:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268429568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572318.708490:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787572318.708545:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e4ad80 x1874405268429568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572318.708565:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268429568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787572319.022949:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787572319.527497:0:9254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00000100:00100000:2.0:1787572319.556742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572319.556794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572319.557018:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244280704 00000100:00100000:1.0:1787572319.557038:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244280704 00000100:00080000:2.0:1787572319.557100:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572319.557122:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:1.0:1787572319.557133:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244280704:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572319.557220:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244280704:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 88us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572319.557228:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:3.0:1787572319.557247:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244280576 00000100:00100000:3.0:1787572319.557253:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244280576 00000100:00100000:3.0:1787572319.557358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 196 00000100:00100000:3.0:1787572319.557369:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244280576:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572319.557400:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244280576:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 35us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572319.557406:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 196 00010000:00010000:1.0:1787572320.052616:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572321.071074:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572322.094932:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787572322.282911:0:9352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00000100:00100000:2.0:1787572322.807976:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268429696:0@lo:400:kworker.0 00000100:00100000:2.0:1787572322.808054:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572322.808164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268429696 00000100:00100000:3.0:1787572322.808173:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268429696 00000100:00100000:3.0:1787572322.808243:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787572322.808253:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268429696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.814626:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268429824:0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.814747:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572322.814787:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572322.814794:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268429952:0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.814820:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572322.814859:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268429824 00000100:00100000:1.0:1787572322.814867:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268429824 00000100:00100000:1.0:1787572322.814911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268429952 00000100:00100000:1.0:1787572322.814914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268429952 00000100:00100000:1.0:1787572322.814944:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787572322.814953:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268429824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.815009:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268429824:12345-0@lo:400:kworker.0 Request processed in 57us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572322.815016:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787572322.815032:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787572322.815039:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268429952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.815065:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268429952:12345-0@lo:400:kworker.0 Request processed in 27us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572322.815071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787572322.815089:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572322.815121:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268429952:0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.815131:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268429824:0@lo:400:kworker.0 00000100:00100000:3.0:1787572322.815727:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268429696:12345-0@lo:400:kworker.0 Request processed in 7473us (7670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572322.815799:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787572322.815853:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268430080:0@lo:400:kworker.0 00000100:00100000:3.0:1787572322.815885:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572322.816029:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268429696:0@lo:400:kworker.0 00000100:00100000:3.0:1787572322.816271:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787572322.816362:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572322.816371:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268430336:0@lo:400:kworker.0 00000100:00100000:2.0:1787572322.816417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572322.817125:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268430208:0@lo:400:kworker.0 00000100:00100000:3.0:1787572322.817161:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572322.817913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268430208 00000100:00100000:0.0:1787572322.817922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268430208 00000100:00100000:0.0:1787572322.817984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787572322.817994:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268430208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572322.818054:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268430208:12345-0@lo:400:kworker.0 Request processed in 62us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572322.818061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787572322.819674:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572322.819742:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268430208:0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.820127:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268430080 00000100:00100000:1.0:1787572322.820135:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268430080 00000100:00100000:1.0:1787572322.820202:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268430336 00000100:00100000:1.0:1787572322.820206:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268430336 00000100:00100000:1.0:1787572322.820221:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787572322.820229:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268430080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.820325:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268430080:12345-0@lo:400:kworker.0 Request processed in 96us (4439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572322.820332:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787572322.820346:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787572322.820352:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268430336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572322.825314:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268430336:12345-0@lo:400:kworker.0 Request processed in 4947us (8881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572322.825336:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787572322.825426:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e70380 x1874405268430080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572322.825444:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268430080:0@lo:400:kworker.0 00000100:00080000:3.0:1787572322.830353:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572322.830364:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787572322.831432:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e71880 x1874405268430336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572322.831450:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268430336:0@lo:400:kworker.0 00010000:00010000:3.0:1787572323.120003:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572323.310878:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572323.310903:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268430464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572323.310992:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572323.311311:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268430464 00000100:00100000:0.0:1787572323.311320:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268430464 00000100:00100000:0.0:1787572323.311381:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787572323.311392:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268430464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787572323.311431:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572323.311491:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268430464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572323.311498:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787572323.311590:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fbd14700 x1874405268430464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572323.311611:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268430464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572323.824431:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268430592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572323.824535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572323.824685:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268430592 00000100:00100000:0.0:1787572323.824695:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268430592 00000100:00100000:0.0:1787572323.824758:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787572323.824779:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268430592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572323.824818:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572323.824865:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268430592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572323.824882:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787572323.825228:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e71880 x1874405268430592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572323.825252:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268430592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787572324.143130:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572324.685555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572324.685603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572324.685683:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244280832 00000100:00100000:3.0:1787572324.685696:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244280832 00000100:00100000:3.0:1787572324.685790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 198 00000100:00100000:3.0:1787572324.685806:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:2355:x1874405244280832:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572324.685933:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:2355:x1874405244280832:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 132us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572324.685941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 198 00000100:00100000:1.0:1787572324.693372:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244280960 00000100:00100000:1.0:1787572324.693393:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244280960 00000100:00080000:3.0:1787572324.693480:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572324.693490:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:1.0:1787572324.693506:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244280960:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572324.693601:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244280960:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 99us (7996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572324.693609:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00010000:00010000:3.0:1787572325.168053:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787572325.247486:0:9449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:3.0:1787572326.202201:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787572327.051264:0:9497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 07:52:03 EDT 2026 00010000:00010000:3.0:1787572327.220703:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572327.918902:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268430848:0@lo:400:kworker.0 00000100:00100000:0.0:1787572327.918998:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572327.919064:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268431360:0@lo:400:kworker.0 00000100:00100000:0.0:1787572327.919093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572327.919133:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572327.919140:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268430976:0@lo:400:kworker.0 00000100:00100000:0.0:1787572327.919164:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572327.919214:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268430848 00000100:00100000:0.0:1787572327.919224:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268430848 00000100:00100000:0.0:1787572327.919278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268430976 00000100:00100000:0.0:1787572327.919281:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268430976 00000100:00100000:0.0:1787572327.919320:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787572327.919330:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268430848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572327.919403:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268430848:12345-0@lo:400:kworker.0 Request processed in 75us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572327.919412:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787572327.919432:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787572327.919438:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268430976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572327.919464:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268430976:12345-0@lo:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572327.919470:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787572327.919486:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572327.919519:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268430976:0@lo:400:kworker.0 00000100:00100000:0.0:1787572327.919529:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268430848:0@lo:400:kworker.0 00000100:00100000:3.0:1787572327.920046:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268430720:0@lo:400:kworker.0 00000100:00100000:3.0:1787572327.920095:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572327.920128:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268431232:0@lo:400:kworker.0 00000100:00100000:3.0:1787572327.920154:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572327.920172:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572327.920178:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268431104:0@lo:400:kworker.0 00000100:00100000:3.0:1787572327.920213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572327.920292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268430720 00000100:00100000:3.0:1787572327.920297:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268430720 00000100:00100000:3.0:1787572327.920335:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787572327.920355:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268430720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572327.920394:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268430720:12345-0@lo:400:kworker.0 Request processed in 40us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572327.920400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787572327.920545:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268430720:0@lo:400:kworker.0 00000100:00100000:0.0:1787572327.921087:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268431232 00000100:00100000:0.0:1787572327.921094:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268431232 00000100:00100000:0.0:1787572327.921145:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787572327.921153:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268431232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572327.921219:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268431232:12345-0@lo:400:kworker.0 Request processed in 66us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572327.921227:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787572327.921261:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268431232:0@lo:400:kworker.0 00000100:00080000:2.0:1787572327.921433:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572327.923491:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268431360 00000100:00100000:1.0:1787572327.923511:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268431360 00000100:00100000:1.0:1787572327.923579:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268431104 00000100:00100000:1.0:1787572327.923584:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268431104 00000100:00100000:1.0:1787572327.923619:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787572327.923629:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268431360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572327.923756:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268431360:12345-0@lo:400:kworker.0 Request processed in 128us (4661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572327.923764:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787572327.923781:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787572327.923787:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268431104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572327.923827:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268431104:12345-0@lo:400:kworker.0 Request processed in 40us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572327.923832:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787572327.924069:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e70380 x1874405268431360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572327.924111:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268431360:0@lo:400:kworker.0 00000100:00080000:0.0:1787572327.924315:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572327.924321:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787572327.924368:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e71500 x1874405268431104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572327.924380:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268431104:0@lo:400:kworker.0 00010000:00010000:1.0:1787572328.238878:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572328.432043:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268431488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572328.432116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572328.432219:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268431488 00000100:00100000:3.0:1787572328.432228:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268431488 00000100:00100000:3.0:1787572328.432359:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787572328.432371:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268431488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572328.432406:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572328.436399:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268431488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4018us (4269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572328.436414:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787572328.437305:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1c7cfb100 x1874405268431488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572328.437329:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268431488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572328.944072:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572328.944095:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268431616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572328.944180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572328.944247:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268431616 00000100:00100000:1.0:1787572328.944257:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268431616 00000100:00100000:1.0:1787572328.944316:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787572328.944327:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268431616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787572328.944365:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572328.944409:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268431616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572328.944415:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787572328.944455:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f4199c00 x1874405268431616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572328.944487:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268431616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787572329.264595:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572329.806694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572329.806743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572329.806777:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244281216 00000100:00100000:0.0:1787572329.806788:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244281216 00000100:00100000:0.0:1787572329.806853:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:0.0:1787572329.806864:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244281216:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572329.806960:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244281216:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 98us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572329.806968:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00080000:0.0:1787572329.806989:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572329.807364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244281088 00000100:00100000:3.0:1787572329.807375:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244281088 00000100:00100000:3.0:1787572329.807429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 200 00000100:00100000:3.0:1787572329.807448:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:2355:x1874405244281088:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572329.807480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:2355:x1874405244281088:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 43us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572329.807486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 200 00010000:00010000:0.0:1787572330.288718:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572331.313738:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572332.335799:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572333.043066:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268432128:0@lo:400:kworker.0 00000100:00100000:3.0:1787572333.043170:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572333.043245:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787572333.043253:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268431744:0@lo:400:kworker.0 00000100:00100000:3.0:1787572333.043283:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572333.043307:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268432256:0@lo:400:kworker.0 00000100:00100000:3.0:1787572333.043331:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572333.043358:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268431872:0@lo:400:kworker.0 00000100:00100000:3.0:1787572333.043382:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572333.043399:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268432384:0@lo:400:kworker.0 00000100:00100000:3.0:1787572333.043420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572333.043436:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572333.043442:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268432000:0@lo:400:kworker.0 00000100:00100000:3.0:1787572333.043462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572333.043557:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268432256 00000100:00100000:2.0:1787572333.043566:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268432256 00000100:00100000:2.0:1787572333.043620:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268431872 00000100:00100000:2.0:1787572333.043624:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268431872 00000100:00100000:2.0:1787572333.043661:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268432000 00000100:00100000:2.0:1787572333.043664:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268432000 00000100:00100000:2.0:1787572333.043683:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787572333.043692:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268432256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572333.043763:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268432256:12345-0@lo:400:kworker.0 Request processed in 71us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572333.043769:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787572333.043786:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787572333.043791:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268431872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572333.043817:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268431872:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572333.043823:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787572333.043834:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787572333.043839:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268432000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572333.043862:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268432000:12345-0@lo:400:kworker.0 Request processed in 23us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572333.043867:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787572333.043884:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268431744 00000100:00100000:2.0:1787572333.043887:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268431744 00000100:00100000:2.0:1787572333.043909:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787572333.043915:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268431744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572333.043954:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268431744:12345-0@lo:400:kworker.0 Request processed in 39us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572333.043960:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787572333.043985:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268432128 00000100:00100000:2.0:1787572333.043989:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268432128 00000100:00100000:2.0:1787572333.044014:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268432384 00000100:00100000:2.0:1787572333.044017:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268432384 00000100:00100000:2.0:1787572333.044031:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787572333.044037:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268432128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572333.044066:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268432128:12345-0@lo:400:kworker.0 Request processed in 29us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572333.044073:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787572333.044084:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787572333.044103:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268432384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572333.044130:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268432384:12345-0@lo:400:kworker.0 Request processed in 28us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572333.044135:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787572333.044155:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787572333.044158:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572333.044161:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572333.044220:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268431744:0@lo:400:kworker.0 00000100:00100000:2.0:1787572333.044234:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268432256:0@lo:400:kworker.0 00010000:00080000:2.0:1787572333.044247:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d2a00 x1874405268432128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572333.044256:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268432128:0@lo:400:kworker.0 00000100:00100000:3.0:1787572333.045729:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268431872:0@lo:400:kworker.0 00010000:00080000:3.0:1787572333.045747:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d1c00 x1874405268432384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572333.045758:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268432384:0@lo:400:kworker.0 00000100:00100000:3.0:1787572333.045807:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268432000:0@lo:400:kworker.0 00010000:00010000:0.0:1787572333.359230:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572333.553555:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268432512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572333.553631:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572333.554764:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268432512 00000100:00100000:1.0:1787572333.554775:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268432512 00000100:00100000:1.0:1787572333.554821:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787572333.554830:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268432512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787572333.554867:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572333.560816:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268432512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5977us (7175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572333.560831:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787572333.561192:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1c7cfad80 x1874405268432512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572333.561214:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268432512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572334.069338:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572334.069362:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268432640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572334.069433:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572334.069475:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268432640 00000100:00100000:0.0:1787572334.069484:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268432640 00000100:00100000:0.0:1787572334.069542:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787572334.069554:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268432640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572334.069589:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572334.069668:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268432640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572334.069676:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787572334.073463:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d1c00 x1874405268432640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572334.073494:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268432640:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787572334.383141:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572334.912524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572334.912708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572334.917765:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244281472 00000100:00100000:2.0:1787572334.917780:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244281472 00000100:00100000:2.0:1787572334.917878:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:2.0:1787572334.917890:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244281472:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572334.917982:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244281472:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 95us (5274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572334.917990:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00080000:0.0:1787572334.918192:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572334.920971:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244281344 00000100:00100000:1.0:1787572334.920987:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244281344 00000100:00100000:3.0:1787572334.921183:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 202 00000100:00100000:3.0:1787572334.921196:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244281344:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572334.921283:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244281344:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 91us (8780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572334.921292:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 202 00010000:00010000:1.0:1787572335.410571:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572336.430867:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572337.461927:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572338.161737:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268432768:0@lo:400:kworker.0 00000100:00100000:1.0:1787572338.161760:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268433152:0@lo:400:kworker.0 00000100:00100000:1.0:1787572338.161818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572338.161877:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572338.161929:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572338.161936:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268433280:0@lo:400:kworker.0 00000100:00100000:1.0:1787572338.161964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572338.162085:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268432768 00000100:00100000:2.0:1787572338.162093:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268432768 00000100:00100000:2.0:1787572338.162141:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787572338.162151:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268432768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572338.162271:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268432768:12345-0@lo:400:kworker.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572338.162279:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787572338.162354:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268432896:0@lo:400:kworker.0 00000100:00100000:1.0:1787572338.162451:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572338.163335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268433280 00000100:00100000:2.0:1787572338.163344:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268433280 00000100:00100000:2.0:1787572338.163399:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268432896 00000100:00100000:2.0:1787572338.163412:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268432896 00000100:00100000:2.0:1787572338.163433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787572338.163441:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268433280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572338.163499:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268433280:12345-0@lo:400:kworker.0 Request processed in 59us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572338.163506:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787572338.163521:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787572338.163527:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268432896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572338.163578:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268432896:12345-0@lo:400:kworker.0 Request processed in 51us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572338.163583:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787572338.163603:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268433152 00000100:00100000:2.0:1787572338.163607:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268433152 00000100:00100000:2.0:1787572338.163662:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787572338.163670:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268433152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572338.163706:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268433152:12345-0@lo:400:kworker.0 Request processed in 37us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572338.163712:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787572338.163735:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268433024:0@lo:400:kworker.0 00000100:00100000:2.0:1787572338.163779:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572338.163814:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268433024 00000100:00100000:2.0:1787572338.163817:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268433024 00000100:00100000:2.0:1787572338.163836:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787572338.163842:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268433024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572338.163877:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268433024:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572338.163883:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787572338.163926:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268433024:0@lo:400:kworker.0 00000100:00100000:1.0:1787572338.164051:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268433408:0@lo:400:kworker.0 00000100:00100000:1.0:1787572338.164083:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572338.164121:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268432896:0@lo:400:kworker.0 00000100:00100000:1.0:1787572338.164151:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268433408 00000100:00100000:1.0:1787572338.164154:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268433408 00000100:00100000:1.0:1787572338.164190:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787572338.164465:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268433408:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787572338.164737:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572338.164742:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787572338.164745:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572338.164865:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268433408:12345-0@lo:400:kworker.0 Request processed in 668us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572338.164872:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787572338.164916:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f419ad80 x1874405268433408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572338.164960:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268433408:0@lo:400:kworker.0 00000100:00100000:0.0:1787572338.166310:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268432768:0@lo:400:kworker.0 00000100:00100000:1.0:1787572338.166475:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268433280:0@lo:400:kworker.0 00010000:00080000:1.0:1787572338.166492:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f4198e00 x1874405268433152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572338.166502:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268433152:0@lo:400:kworker.0 00010000:00010000:2.0:1787572338.478820:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572338.672042:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572338.672072:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268433536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572338.672158:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572338.672230:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268433536 00000100:00100000:1.0:1787572338.672238:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268433536 00000100:00100000:1.0:1787572338.672284:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787572338.672293:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268433536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787572338.672333:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572338.672380:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268433536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572338.672387:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787572338.672427:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1c7cf9f80 x1874405268433536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572338.672446:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268433536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572339.183373:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787572339.183396:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268433664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572339.183477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572339.183544:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268433664 00000100:00100000:0.0:1787572339.183552:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268433664 00000100:00100000:0.0:1787572339.183595:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787572339.183603:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268433664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572339.183686:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572339.183729:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268433664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572339.183736:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787572339.183775:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f3e73480 x1874405268433664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572339.183792:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268433664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787572339.504996:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572340.035078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572340.037010:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244281728 00000100:00100000:3.0:1787572340.037021:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244281728 00000100:00100000:3.0:1787572340.037101:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:3.0:1787572340.037125:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244281728:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572340.037202:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244281728:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 91us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572340.037210:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00080000:2.0:1787572340.037307:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572340.038057:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572340.038143:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244281600 00000100:00100000:2.0:1787572340.038159:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244281600 00000100:00100000:2.0:1787572340.038197:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 204 00000100:00100000:2.0:1787572340.038205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244281600:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572340.038260:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+10:2354:x1874405244281600:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 56us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572340.038267:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 204 00010000:00010000:2.0:1787572340.527744:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572341.551622:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572342.580364:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787572343.254209:0:10128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:52:19 (1787572339) === 00000100:00100000:1.0:1787572343.280142:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268433792:0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.280233:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572343.280289:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268434304:0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.280326:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572343.280363:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572343.280369:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268434176:0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.280396:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572343.280423:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268433920:0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.280560:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572343.280580:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268434432:0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.280602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572343.280619:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572343.280624:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268434048:0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.280671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572343.280699:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268434304 00000100:00100000:1.0:1787572343.280706:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268434304 00000100:00100000:1.0:1787572343.280755:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268433920 00000100:00100000:1.0:1787572343.280759:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268433920 00000100:00100000:1.0:1787572343.280771:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268434048 00000100:00100000:1.0:1787572343.280774:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268434048 00000100:00100000:1.0:1787572343.280791:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787572343.280799:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268434304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.280851:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268434304:12345-0@lo:400:kworker.0 Request processed in 52us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572343.280859:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787572343.280875:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787572343.280881:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268433920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.280936:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268433920:12345-0@lo:400:kworker.0 Request processed in 56us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572343.280943:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787572343.281219:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787572343.281228:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268434048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572343.281260:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268434048:12345-0@lo:400:kworker.0 Request processed in 34us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572343.281265:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787572343.281297:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268434176 00000100:00100000:1.0:1787572343.281301:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268434176 00000100:00100000:1.0:1787572343.281381:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268434432 00000100:00100000:1.0:1787572343.281385:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268434432 00000100:00100000:2.0:1787572343.281455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268433792 00000100:00100000:2.0:1787572343.281460:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268433792 00000100:00100000:2.0:1787572343.281488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787572343.281495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268433792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572343.281531:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268433792:12345-0@lo:400:kworker.0 Request processed in 36us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.281536:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:0.0:1787572343.290947:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787572343.292740:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787572343.292763:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572343.292853:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268434176:12345-0@lo:400:kworker.0 Request processed in 100us (12456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572343.292862:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787572343.292885:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787572343.292905:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268434432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572343.292935:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268434432:12345-0@lo:400:kworker.0 Request processed in 43us (12331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572343.292940:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787572343.293118:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572343.293122:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787572343.293254:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1c7cfb100 x1874405268434176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572343.293271:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268434176:0@lo:400:kworker.0 00000100:00100000:0.0:1787572343.293283:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268433792:0@lo:400:kworker.0 00000100:00100000:0.0:1787572343.293295:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268434304:0@lo:400:kworker.0 00000100:00100000:0.0:1787572343.293347:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268434048:0@lo:400:kworker.0 00000100:00100000:0.0:1787572343.293359:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1c7cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268433920:0@lo:400:kworker.0 00010000:00080000:0.0:1787572343.293370:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43cf800 x1874405268434432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572343.293379:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268434432:0@lo:400:kworker.0 00010000:00010000:0.0:1787572343.598836:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572343.766532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572343.766675:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244281856 00000100:00100000:3.0:1787572343.766689:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244281856 00000100:00100000:3.0:1787572343.766771:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 206 00000100:00100000:3.0:1787572343.766785:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+10:8127:x1874405244281856:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787572343.766810:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572343.766854:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f436392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db8b6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572343.766917:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f436392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8b6 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572343.766931:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f436392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8b6 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572343.766943:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eae00, rc 0) 00000100:00100000:3.0:1787572343.767251:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+11:8127:x1874405244281856:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 468us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572343.767259:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 206 00000100:00100000:2.0:1787572343.773262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572343.773451:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244281984 00000100:00100000:0.0:1787572343.773465:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244281984 00000100:00100000:0.0:1787572343.773539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 207 00000100:00100000:0.0:1787572343.773554:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+11:8127:x1874405244281984:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787572343.774277:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+11:8127:x1874405244281984:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 721us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572343.774288:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 207 00000100:00100000:2.0:1787572343.778588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572343.778744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244282112 00000100:00100000:3.0:1787572343.778758:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244282112 00000100:00100000:3.0:1787572343.779079:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 208 00000100:00100000:3.0:1787572343.779093:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+11:8127:x1874405244282112:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787572343.780250:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+11:8127:x1874405244282112:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 1151us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572343.780263:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 208 00000100:00100000:1.0:1787572343.791564:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572343.791603:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268434560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572343.791722:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572343.792143:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268434560 00000100:00100000:2.0:1787572343.792154:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268434560 00000100:00100000:2.0:1787572343.792224:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787572343.792237:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268434560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572343.792286:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572343.792569:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268434560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 333us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.792578:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787572343.792662:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43ce300 x1874405268434560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572343.792685:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268434560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572343.795796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572343.796505:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244282240 00000100:00100000:2.0:1787572343.796520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244282240 00000100:00100000:2.0:1787572343.796611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 209 00000100:00100000:2.0:1787572343.796624:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+11:8131:x1874405244282240:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787572343.798580:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+11:8131:x1874405244282240:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 1943us (2783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.798608:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 209 00000100:00100000:2.0:1787572343.834491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572343.834613:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244282368 00000100:00100000:3.0:1787572343.834628:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244282368 00000100:00100000:3.0:1787572343.834734:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 210 00000100:00100000:3.0:1787572343.834748:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+11:8131:x1874405244282368:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787572343.835382:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+11:8131:x1874405244282368:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 634us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572343.835393:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 210 00000100:00100000:2.0:1787572343.850136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572343.850378:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244282496 00000100:00100000:3.0:1787572343.850392:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244282496 00000100:00100000:3.0:1787572343.850738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 211 00000100:00100000:3.0:1787572343.850752:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+11:8127:x1874405244282496:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787572343.851273:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572343.851303:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1de0eb800/0x9fe530ef4f436399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db8e0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572343.851354:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0eb800/0x9fe530ef4f436399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572343.851368:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1de0eb800/0x9fe530ef4f436399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572343.851378:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb800, rc 0) 00000100:00100000:2.0:1787572343.856356:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+12:8127:x1874405244282496:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 5589us (6221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.856374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 211 00000100:00100000:1.0:1787572343.866109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572343.866287:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244282624 00000100:00100000:3.0:1787572343.866301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244282624 00000100:00100000:3.0:1787572343.866380:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 212 00000100:00100000:3.0:1787572343.866394:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+12:8127:x1874405244282624:12345-192.168.204.55@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787572343.866435:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787572343.866468:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787572343.866473:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787572343.866477:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787572343.866479:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787572343.869426:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+12:8127:x1874405244282624:12345-192.168.204.55@tcp:256:mount.lustre.0 Request processed in 3017us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.869444:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 212 00000100:00100000:2.0:1787572343.873782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572343.873936:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244282752 00000100:00100000:0.0:1787572343.873951:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244282752 00000100:00100000:0.0:1787572343.874033:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 213 00000100:00100000:0.0:1787572343.874045:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+12:8127:x1874405244282752:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787572343.874069:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572343.874093:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db8e7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572343.874133:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572343.874147:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572343.874159:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30e00, rc 0) 00000100:00100000:0.0:1787572343.874242:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:8127:x1874405244282752:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 199us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572343.874250:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 213 00000100:00100000:1.0:1787572343.877708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572343.877904:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244282880 00000100:00100000:2.0:1787572343.877918:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244282880 00000100:00100000:2.0:1787572343.878133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 214 00000100:00100000:2.0:1787572343.878146:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:8127:x1874405244282880:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787572343.878575:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:8127:x1874405244282880:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 431us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.878584:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 214 00000100:00100000:3.0:1787572343.881790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572343.882488:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244283008 00000100:00100000:0.0:1787572343.882520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244283008 00000100:00100000:0.0:1787572343.882608:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 215 00000100:00100000:0.0:1787572343.882621:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:8127:x1874405244283008:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787572343.882992:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:8127:x1874405244283008:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 373us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572343.883002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 215 00000100:00100000:0.0:1787572343.891237:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572343.891690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244283136 00000100:00100000:2.0:1787572343.891706:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244283136 00000100:00100000:2.0:1787572343.891795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 216 00000100:00100000:2.0:1787572343.891808:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:8136:x1874405244283136:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787572343.894152:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:8136:x1874405244283136:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 2333us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.894169:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 216 00000100:00100000:1.0:1787572343.898893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572343.899068:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244283264 00000100:00100000:3.0:1787572343.899082:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244283264 00000100:00100000:3.0:1787572343.899162:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 217 00000100:00100000:3.0:1787572343.899175:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:8136:x1874405244283264:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787572343.899787:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:8136:x1874405244283264:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 612us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572343.899797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 217 00000100:00100000:3.0:1787572343.904064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572343.904702:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244283392 00000100:00100000:1.0:1787572343.904718:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244283392 00000100:00100000:1.0:1787572343.904844:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:1.0:1787572343.904855:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1874405244283392:12345-192.168.204.55@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787572343.904907:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6d6322bb-3191-4d60-88a3-6866da8333ec@192.168.204.55@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:1.0:1787572343.904969:0:5843:0:(genops.c:1385:class_connect()) connect: client 6d6322bb-3191-4d60-88a3-6866da8333ec, cookie 0x9fe530ef4f4363a7 00000004:00100000:1.0:1787572343.905020:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787572343.905408:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf1c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787572343.905711:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2352:x1874405244283392:12345-192.168.204.55@tcp:38:mount.lustre.0 Request processed in 855us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572343.905720:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1787572343.908751:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572343.908905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244283776 00000100:00100000:2.0:1787572343.908920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244283776 00000100:00100000:2.0:1787572343.909136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:2.0:1787572343.909149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244283776:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572343.909257:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244283776:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 112us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.909265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:2.0:1787572343.909394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572343.909977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244283520 00000100:00100000:1.0:1787572343.909987:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244283520 00000100:00080000:0.0:1787572343.910990:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572343.911169:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572343.911256:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244283648 00000100:00100000:3.0:1787572343.911265:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244283648 00000100:00100000:3.0:1787572343.911455:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1787572343.911468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+7:8127:x1874405244283648:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787572343.911532:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787572343.911682:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+7:8127:x1874405244283648:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 216us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572343.911691:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1787572343.914389:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:1.0:1787572343.914408:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+6:0:x1874405244283520:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787572343.914450:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787572343.914546:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+6:0:x1874405244283520:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 143us (5151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572343.914554:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1787572343.914919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572343.915168:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244283904 00000100:00100000:1.0:1787572343.915178:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244283904 00000100:00100000:1.0:1787572343.915216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:1.0:1787572343.915223:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+6:8127:x1874405244283904:12345-192.168.204.55@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787572343.915265:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+6:8127:x1874405244283904:12345-192.168.204.55@tcp:40:mount.lustre.0 Request processed in 43us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572343.915272:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:0.0:1787572343.919220:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572343.919458:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244284288 00000100:00100000:2.0:1787572343.919472:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244284288 00000100:00100000:0.0:1787572343.919549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572343.919752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572343.919858:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:2.0:1787572343.919871:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+6:8127:x1874405244284288:12345-192.168.204.55@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787572343.920224:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787572343.920430:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+6:8127:x1874405244284288:12345-192.168.204.55@tcp:33:mount.lustre.0 Request processed in 560us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.920438:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:1.0:1787572343.924576:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244284032 00000100:00100000:1.0:1787572343.924754:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244284032 00000100:00100000:1.0:1787572343.926528:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244284160 00000100:00100000:1.0:1787572343.926543:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244284160 00000100:00100000:2.0:1787572343.926963:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1787572343.926976:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874405244284032:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787572343.927022:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6d6322bb-3191-4d60-88a3-6866da8333ec@192.168.204.55@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787572343.927087:0:6690:0:(genops.c:1385:class_connect()) connect: client 6d6322bb-3191-4d60-88a3-6866da8333ec, cookie 0x9fe530ef4f4363ae 00002000:00100000:2.0:1787572343.927103:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6d6322bb-3191-4d60-88a3-6866da8333ec/ffff98d0c52f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787572343.927151:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787572343.928457:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787572343.928529:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d0c52f4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572343.928689:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2352:x1874405244284032:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 1711us (9406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.928703:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1787572343.928745:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1787572343.928753:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874405244284160:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787572343.928784:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6d6322bb-3191-4d60-88a3-6866da8333ec@192.168.204.55@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787572343.928813:0:6690:0:(genops.c:1385:class_connect()) connect: client 6d6322bb-3191-4d60-88a3-6866da8333ec, cookie 0x9fe530ef4f4363b5 00002000:00100000:2.0:1787572343.928828:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d6322bb-3191-4d60-88a3-6866da8333ec/ffff98d0c52f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787572343.928841:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787572343.929084:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787572343.929103:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d0c52f5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572343.929133:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2352:x1874405244284160:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 379us (9381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572343.929141:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1787572344.304275:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572344.304308:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268434688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572344.304417:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572344.306362:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268434688 00000100:00100000:1.0:1787572344.306381:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268434688 00000100:00100000:1.0:1787572344.306482:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787572344.306494:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268434688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787572344.306527:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572344.306672:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268434688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572344.306680:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787572344.306739:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d0a80 x1874405268434688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572344.306763:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268434688:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787572344.342339:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d6322bb-3191-4d60-88a3-6866da8333ec 00010000:00010000:0.0:1787572344.626467:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787572345.396808:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d6322bb-3191-4d60-88a3-6866da8333ec 00010000:00010000:0.0:1787572345.647065:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572346.670873:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572347.696500:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572348.401802:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268435072:0@lo:400:kworker.0 00000100:00100000:1.0:1787572348.401894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572348.402035:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268434816:0@lo:400:kworker.0 00000100:00100000:3.0:1787572348.402071:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572348.402100:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268435072 00000100:00100000:3.0:1787572348.402107:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268435072 00000100:00100000:3.0:1787572348.402161:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787572348.402171:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268435072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572348.402215:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268435072:12345-0@lo:400:kworker.0 Request processed in 47us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572348.402221:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787572348.402436:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268434944:0@lo:400:kworker.0 00000100:00100000:2.0:1787572348.402470:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572348.402496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268434816 00000100:00100000:2.0:1787572348.402500:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268434816 00000100:00100000:2.0:1787572348.402538:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787572348.402544:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268434816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572348.402578:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268434816:12345-0@lo:400:kworker.0 Request processed in 34us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572348.402584:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787572348.402621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268434944 00000100:00100000:2.0:1787572348.402626:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268434944 00000100:00100000:2.0:1787572348.402667:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787572348.402674:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268434944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572348.402706:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268434944:12345-0@lo:400:kworker.0 Request processed in 33us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572348.402712:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787572348.402879:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268435200:0@lo:400:kworker.0 00000100:00100000:0.0:1787572348.402910:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787572348.402946:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572348.403099:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268435200 00000100:00100000:3.0:1787572348.403104:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268435200 00000100:00100000:3.0:1787572348.403146:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787572348.403154:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268435200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572348.403189:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268435200:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572348.403195:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787572348.403362:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268435072:0@lo:400:kworker.0 00000100:00100000:3.0:1787572348.403462:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268434816:0@lo:400:kworker.0 00000100:00100000:3.0:1787572348.403469:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268435328:0@lo:400:kworker.0 00000100:00100000:3.0:1787572348.403494:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572348.403531:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268435328 00000100:00100000:3.0:1787572348.403534:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268435328 00000100:00100000:3.0:1787572348.403559:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787572348.403566:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268435328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572348.403599:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268435328:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572348.403605:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787572348.403632:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268435328:0@lo:400:kworker.0 00000100:00080000:0.0:1787572348.404406:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787572348.404412:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787572348.404444:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f419ad80 x1874405268435200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572348.404457:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268435200:0@lo:400:kworker.0 00000100:00100000:0.0:1787572348.405889:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268434944:0@lo:400:kworker.0 00000100:00100000:0.0:1787572348.405902:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268435456:0@lo:400:kworker.0 00000100:00100000:0.0:1787572348.405972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572348.407476:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268435456 00000100:00100000:2.0:1787572348.407487:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268435456 00000100:00100000:2.0:1787572348.407557:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787572348.407568:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268435456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572348.407669:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268435456:12345-0@lo:400:kworker.0 Request processed in 103us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572348.407677:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787572348.408246:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787572348.408289:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f447bb80 x1874405268435456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572348.408306:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268435456:0@lo:400:kworker.0 00000001:00100000:0.0:1787572348.479190:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d6322bb-3191-4d60-88a3-6866da8333ec 00010000:00010000:0.0:1787572348.721300:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572348.910925:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268435584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572348.911019:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572348.911666:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268435584 00000100:00100000:2.0:1787572348.911675:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268435584 00000100:00100000:2.0:1787572348.911733:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787572348.911745:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268435584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572348.911796:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572348.911860:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268435584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572348.911868:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787572348.911980:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43cea00 x1874405268435584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572348.912000:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268435584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572349.253357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572349.253399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572349.253433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572349.253472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572349.253498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572349.253582:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244284544 00000100:00100000:2.0:1787572349.253592:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244284544 00000100:00100000:3.0:1787572349.253618:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244284800 00000100:00100000:3.0:1787572349.253625:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244284800 00000100:00100000:2.0:1787572349.253695:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244284672 00000100:00100000:3.0:1787572349.253698:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244284928 00000100:00100000:2.0:1787572349.253700:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244284672 00000100:00100000:3.0:1787572349.253704:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244284928 00000100:00100000:2.0:1787572349.253734:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:3.0:1787572349.253745:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:2.0:1787572349.253748:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244284544:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572349.253774:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244284800:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572349.253854:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244284800:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 86us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572349.253862:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:3.0:1787572349.253880:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:3.0:1787572349.253888:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244284928:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572349.253953:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244284416 00000100:00100000:1.0:1787572349.253957:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244284416 00000100:00100000:1.0:1787572349.253987:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 219 00000100:00100000:1.0:1787572349.253994:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244284416:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572349.256787:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244284544:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 3011us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572349.256803:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:2.0:1787572349.256841:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:2.0:1787572349.256853:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244284672:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572349.256898:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244284672:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 50us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572349.256903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00080000:2.0:1787572349.256995:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787572349.257000:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572349.257003:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572349.259725:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244284928:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 5825us (6213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572349.259743:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:1.0:1787572349.259947:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244284416:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 5950us (6509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572349.260024:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 219 00000100:00100000:3.0:1787572349.422824:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572349.422849:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268435712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572349.422921:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572349.423519:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268435712 00000100:00100000:1.0:1787572349.423528:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268435712 00000100:00100000:1.0:1787572349.423577:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787572349.423586:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268435712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787572349.423624:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572349.423694:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268435712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572349.423709:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787572349.424171:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d0380 x1874405268435712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572349.424193:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268435712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787572349.743034:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787572350.519065:0:10325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787572350.771075:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572351.790863:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572352.815355:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572353.519553:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268435840:0@lo:400:kworker.0 00000100:00100000:3.0:1787572353.519673:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572353.519752:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268435840 00000100:00100000:3.0:1787572353.519760:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268435840 00000100:00100000:3.0:1787572353.519811:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787572353.519820:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268435840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572353.519870:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268435840:12345-0@lo:400:kworker.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572353.519877:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787572353.519946:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268435840:0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.520061:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268436224:0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.520090:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572353.520113:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572353.520119:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268436352:0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.520143:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572353.520169:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268435968:0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.520192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572353.520208:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268436480:0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.520229:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572353.520246:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572353.520251:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268436096:0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.520269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572353.520292:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268436224 00000100:00100000:1.0:1787572353.520296:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268436224 00000100:00100000:1.0:1787572353.520330:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268436480 00000100:00100000:1.0:1787572353.520334:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268436480 00000100:00100000:1.0:1787572353.520349:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787572353.520355:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268436224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.520390:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268436224:12345-0@lo:400:kworker.0 Request processed in 35us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572353.520396:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787572353.520510:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787572353.520519:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f41e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572353.520553:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f41e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268436480:12345-0@lo:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572353.520559:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787572353.522885:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268436352 00000100:00100000:1.0:1787572353.522901:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268436352 00000100:00100000:1.0:1787572353.522953:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268435968 00000100:00100000:1.0:1787572353.522966:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268435968 00000100:00100000:1.0:1787572353.522983:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268436096 00000100:00100000:1.0:1787572353.522986:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268436096 00000100:00100000:1.0:1787572353.523006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787572353.523016:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268436352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.523098:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268436352:12345-0@lo:400:kworker.0 Request processed in 83us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572353.523104:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787572353.523118:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787572353.523124:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268435968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.523159:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268435968:12345-0@lo:400:kworker.0 Request processed in 36us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572353.523165:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787572353.523175:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787572353.523181:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268436096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.523207:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268436096:12345-0@lo:400:kworker.0 Request processed in 26us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572353.523213:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787572353.523242:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787572353.523246:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787572353.523249:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787572353.523287:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268436352:0@lo:400:kworker.0 00010000:00080000:1.0:1787572353.523304:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f447aa00 x1874405268436224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572353.523317:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268436224:0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.523355:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268436096:0@lo:400:kworker.0 00000100:00100000:1.0:1787572353.523375:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268435968:0@lo:400:kworker.0 00010000:00080000:1.0:1787572353.523386:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f4479c00 x1874405268436480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572353.523395:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268436480:0@lo:400:kworker.0 00010000:00010000:0.0:1787572353.842038:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572354.032115:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572354.032151:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268436608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572354.032225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572354.032300:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268436608 00000100:00100000:3.0:1787572354.032308:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268436608 00000100:00100000:3.0:1787572354.032783:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787572354.032796:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268436608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572354.032837:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572354.032888:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268436608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572354.032895:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787572354.033038:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d0380 x1874405268436608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572354.033058:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268436608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572354.370583:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572354.370630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572354.370702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572354.370724:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572354.370750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572354.370837:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244285184 00000100:00100000:2.0:1787572354.370847:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244285184 00000100:00100000:2.0:1787572354.370911:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244285312 00000100:00100000:2.0:1787572354.370915:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244285312 00000100:00100000:2.0:1787572354.370940:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:2.0:1787572354.370950:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244285184:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572354.371040:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244285184:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 91us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572354.371047:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:2.0:1787572354.371065:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:2.0:1787572354.371072:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244285312:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572354.371103:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244285312:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 31us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572354.371109:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:3.0:1787572354.371934:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244285440 00000100:00100000:3.0:1787572354.371941:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244285440 00000100:00100000:3.0:1787572354.371979:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244285568 00000100:00100000:3.0:1787572354.371982:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244285568 00000100:00100000:3.0:1787572354.372001:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1787572354.372009:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244285440:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572354.372056:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244285440:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 48us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572354.372229:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1787572354.372257:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:3.0:1787572354.372264:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244285568:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572354.372292:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244285568:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 29us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572354.372298:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00080000:0.0:1787572354.372723:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787572354.372729:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572354.372733:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572354.372885:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244285056 00000100:00100000:1.0:1787572354.372891:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244285056 00000100:00100000:1.0:1787572354.372936:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 221 00000100:00100000:1.0:1787572354.372944:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244285056:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572354.372987:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244285056:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 44us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572354.372993:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 221 00000100:00100000:1.0:1787572354.544126:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268436736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572354.544204:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572354.546580:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268436736 00000100:00100000:3.0:1787572354.546595:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268436736 00000100:00100000:3.0:1787572354.546690:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787572354.546703:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268436736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787572354.546752:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572354.546886:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268436736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572354.546893:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787572354.547068:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d0380 x1874405268436736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572354.547091:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268436736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787572354.867555:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572355.887488:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572356.914357:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572357.934868:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572358.649477:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268436864:0@lo:400:kworker.0 00000100:00100000:0.0:1787572358.649487:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268437120:0@lo:400:kworker.0 00000100:00100000:2.0:1787572358.650706:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268436992:0@lo:400:kworker.0 00000100:00100000:1.0:1787572358.650916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572358.650981:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268437376:0@lo:400:kworker.0 00000100:00100000:1.0:1787572358.651007:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572358.651034:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572358.651041:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268437248:0@lo:400:kworker.0 00000100:00100000:1.0:1787572358.651065:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572358.651093:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268437376 00000100:00100000:1.0:1787572358.651100:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268437376 00000100:00100000:1.0:1787572358.651153:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787572358.651162:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268437376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572358.651230:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268437376:12345-0@lo:400:kworker.0 Request processed in 68us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572358.651238:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787572358.651362:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268436864 00000100:00100000:3.0:1787572358.651367:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268436864 00000100:00100000:3.0:1787572358.651416:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787572358.651424:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268436864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572358.651459:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268436864:12345-0@lo:400:kworker.0 Request processed in 36us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572358.651465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787572358.651494:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268437248 00000100:00100000:3.0:1787572358.651498:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268437248 00000100:00100000:3.0:1787572358.651526:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787572358.651534:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268437248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572358.651566:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268437248:12345-0@lo:400:kworker.0 Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572358.651566:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572358.651582:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787572358.651625:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572358.651630:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572358.651654:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268437120 00000100:00100000:0.0:1787572358.651658:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268437120 00000100:00100000:0.0:1787572358.651731:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787572358.651739:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268437120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572358.651776:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268437120:12345-0@lo:400:kworker.0 Request processed in 38us (209us total) trans 0 rc 0/0 00000100:00080000:3.0:1787572358.651864:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572358.651986:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787572358.652286:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268437120:0@lo:400:kworker.0 00000100:00100000:2.0:1787572358.652912:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572358.652937:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268437504:0@lo:400:kworker.0 00000100:00100000:2.0:1787572358.652963:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572358.653004:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268436992 00000100:00100000:2.0:1787572358.653009:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268436992 00000100:00100000:2.0:1787572358.653046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787572358.653058:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268436992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572358.653098:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268436992:12345-0@lo:400:kworker.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572358.653105:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787572358.653148:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268436992:0@lo:400:kworker.0 00010000:00080000:1.0:1787572358.654886:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f4479180 x1874405268437248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572358.654902:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268437248:0@lo:400:kworker.0 00000100:00100000:1.0:1787572358.654915:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268436864:0@lo:400:kworker.0 00000100:00100000:1.0:1787572358.654927:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268437376:0@lo:400:kworker.0 00000100:00100000:1.0:1787572358.655045:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268437504 00000100:00100000:1.0:1787572358.655052:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268437504 00000100:00100000:1.0:1787572358.655107:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787572358.655113:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787572358.655118:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268437504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572358.655193:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268437504:12345-0@lo:400:kworker.0 Request processed in 78us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572358.655200:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787572358.655228:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f4479500 x1874405268437504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572358.655250:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268437504:0@lo:400:kworker.0 00010000:00010000:2.0:1787572358.958782:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572359.166048:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572359.166074:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268437632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572359.166146:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572359.166223:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268437632 00000100:00100000:3.0:1787572359.166232:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268437632 00000100:00100000:3.0:1787572359.166284:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787572359.166294:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268437632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572359.166343:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572359.166623:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268437632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 329us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572359.166632:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787572359.175829:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d3100 x1874405268437632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572359.175860:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268437632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572359.495056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572359.495100:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244285696 00000100:00100000:0.0:1787572359.495111:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244285696 00000100:00100000:0.0:1787572359.495159:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 223 00000100:00100000:0.0:1787572359.495170:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244285696:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572359.495242:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244285696:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572359.495250:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 223 00000100:00100000:0.0:1787572359.520929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572359.521024:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572359.521053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572359.521116:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244286080 00000100:00100000:3.0:1787572359.521127:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244286080 00000100:00100000:3.0:1787572359.521208:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:3.0:1787572359.521220:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244286080:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572359.521319:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244286080:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 100us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572359.521326:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00080000:3.0:1787572359.521348:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572359.529231:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572359.529716:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244285824 00000100:00100000:1.0:1787572359.529867:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244285824 00000100:00100000:1.0:1787572359.529987:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244285952 00000100:00100000:1.0:1787572359.529993:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244285952 00000100:00080000:0.0:1787572359.530020:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572359.530053:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:0.0:1787572359.530131:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244285824:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572359.530271:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244285824:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 208us (9352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572359.530279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:3.0:1787572359.531193:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244286208 00000100:00100000:3.0:1787572359.531204:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244286208 00000100:00100000:1.0:1787572359.532227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:1.0:1787572359.532240:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244285952:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572359.532630:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244285952:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 392us (11574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572359.532657:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:3.0:1787572359.547936:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1787572359.547957:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244286208:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572359.548170:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244286208:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 222us (18951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572359.548193:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00080000:3.0:1787572359.548223:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787572359.663851:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268437760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572359.663933:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572359.664685:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268437760 00000100:00100000:3.0:1787572359.664694:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268437760 00000100:00100000:3.0:1787572359.664756:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787572359.664765:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268437760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787572359.664811:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572359.664867:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268437760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572359.664873:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787572359.664915:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d0a80 x1874405268437760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572359.664935:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268437760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787572359.983464:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572361.008717:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572362.040441:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572363.054751:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572363.761604:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268437888:0@lo:400:kworker.0 00000100:00100000:1.0:1787572363.761716:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572363.762175:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268437888 00000100:00100000:2.0:1787572363.762185:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268437888 00000100:00100000:2.0:1787572363.762249:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787572363.762260:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268437888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572363.762312:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268437888:12345-0@lo:400:kworker.0 Request processed in 54us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572363.762318:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787572363.763199:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268437888:0@lo:400:kworker.0 00000100:00100000:1.0:1787572363.763212:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268438400:0@lo:400:kworker.0 00000100:00100000:1.0:1787572363.763250:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572363.763332:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572363.763339:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268438272:0@lo:400:kworker.0 00000100:00100000:1.0:1787572363.763377:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572363.763428:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268438272 00000100:00100000:1.0:1787572363.763433:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268438016:0@lo:400:kworker.0 00000100:00100000:2.0:1787572363.763434:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268438272 00000100:00100000:1.0:1787572363.763458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572363.763484:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787572363.763492:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268438272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572363.763550:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268438272:12345-0@lo:400:kworker.0 Request processed in 59us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572363.763557:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787572363.763716:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572363.772730:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268438144:0@lo:400:kworker.0 00000100:00100000:1.0:1787572363.775661:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572363.775796:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268438400 00000100:00100000:0.0:1787572363.775807:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268438400 00000100:00100000:0.0:1787572363.775873:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268438016 00000100:00100000:0.0:1787572363.775877:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268438016 00000100:00100000:0.0:1787572363.775915:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787572363.775925:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268438400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572363.776000:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268438400:12345-0@lo:400:kworker.0 Request processed in 77us (12749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572363.776008:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787572363.776026:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787572363.776032:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268438016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572363.776063:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268438016:12345-0@lo:400:kworker.0 Request processed in 30us (12603us total) trans 0 rc 0/0 00000100:00080000:3.0:1787572363.776217:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572363.777343:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1787572363.787006:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f4478a80 x1874405268438272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572363.787026:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268438272:0@lo:400:kworker.0 00000100:00100000:0.0:1787572363.787041:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268438400:0@lo:400:kworker.0 00000100:00100000:0.0:1787572363.787112:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268438016:0@lo:400:kworker.0 00000100:00100000:0.0:1787572363.787123:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268438528:0@lo:400:kworker.0 00000100:00100000:0.0:1787572363.787192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572363.788654:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268438144 00000100:00100000:1.0:1787572363.788668:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268438144 00000100:00100000:1.0:1787572363.788759:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787572363.788767:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268438144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572363.788836:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268438144:12345-0@lo:400:kworker.0 Request processed in 70us (13184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572363.788843:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787572363.788865:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572363.789006:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268438528 00000100:00100000:3.0:1787572363.789010:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268438528 00000100:00100000:1.0:1787572363.789062:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268438144:0@lo:400:kworker.0 00000100:00100000:3.0:1787572363.792051:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787572363.792090:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268438528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572363.792184:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268438528:12345-0@lo:400:kworker.0 Request processed in 121us (4992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572363.792191:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787572363.792242:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f4479500 x1874405268438528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572363.792274:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268438528:0@lo:400:kworker.0 00000100:00080000:1.0:1787572363.792419:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787572364.079535:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572364.272539:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572364.272562:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572364.272657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572364.272736:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268438656 00000100:00100000:3.0:1787572364.272746:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268438656 00000100:00100000:3.0:1787572364.272811:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787572364.272823:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268438656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572364.272861:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572364.272907:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268438656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572364.272913:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787572364.272967:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d0a80 x1874405268438656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572364.272988:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572364.626151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572364.626321:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244286336 00000100:00100000:0.0:1787572364.626332:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244286336 00000100:00100000:0.0:1787572364.626393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 225 00000100:00100000:0.0:1787572364.626404:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244286336:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572364.626475:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244286336:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 73us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572364.626563:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 225 00000100:00100000:1.0:1787572364.627069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572364.627095:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244286592 00000100:00100000:1.0:1787572364.627100:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244286592 00000100:00100000:1.0:1787572364.627141:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:1.0:1787572364.627150:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244286592:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572364.627188:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244286592:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 40us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572364.627208:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00080000:1.0:1787572364.627226:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572364.633328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572364.633373:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572364.633406:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244286720 00000100:00100000:2.0:1787572364.633417:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244286720 00000100:00100000:2.0:1787572364.633512:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:2.0:1787572364.633524:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2352:x1874405244286720:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:2.0:1787572364.633558:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4363ae 00000100:00080000:2.0:1787572364.633568:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d0c52f4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787572364.633608:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787572364.634122:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+2:2352:x1874405244286720:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 598us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572364.634130:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00080000:2.0:1787572364.634154:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787572364.634163:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572364.634259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572364.634390:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244286464 00000100:00100000:1.0:1787572364.634396:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244286464 00000100:00100000:1.0:1787572364.634437:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:1.0:1787572364.634445:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244286464:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572364.634495:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244286464:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 51us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572364.634502:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:1.0:1787572364.635049:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244286848 00000100:00100000:1.0:1787572364.635054:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244286848 00000100:00100000:1.0:1787572364.635086:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1787572364.635092:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2352:x1874405244286848:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:1.0:1787572364.635109:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4363b5 00000100:00080000:1.0:1787572364.635114:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98d0c52f5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787572364.635148:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787572364.635408:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+2:2352:x1874405244286848:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 315us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572364.635416:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00010000:00010000:1.0:1787572364.635446:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787572364.635452:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787572364.635456:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572364.782942:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268438784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572364.783010:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572364.783159:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268438784 00000100:00100000:3.0:1787572364.783166:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268438784 00000100:00100000:3.0:1787572364.783242:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787572364.783254:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268438784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787572364.783288:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572364.783335:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268438784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572364.783341:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787572364.783377:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d0a80 x1874405268438784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572364.783401:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268438784:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787572365.103974:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787572365.854794:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d6322bb-3191-4d60-88a3-6866da8333ec 00000020:00000080:3.0:1787572365.854874:0:6719:0:(genops.c:885:class_export_put()) final put ffff98d0c52f7000/6d6322bb-3191-4d60-88a3-6866da8333ec 00000020:00000080:0.0:1787572365.854947:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c52f7000/6d6322bb-3191-4d60-88a3-6866da8333ec for lustre-OST0000 00000020:00000080:0.0:1787572365.854992:0:473:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c52f4000 for lustre-OST0000 00010000:00010000:1.0:1787572366.131890:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572367.151455:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572368.175622:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572368.880819:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268438912:0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.881115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572368.881184:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268439424:0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.881222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572368.881259:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572368.881265:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268439296:0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.881292:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572368.881329:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268439040:0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.881356:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572368.881377:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268439552:0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.881411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572368.881431:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572368.881438:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268439168:0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.881462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572368.883071:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268438912 00000100:00100000:3.0:1787572368.883086:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268438912 00000100:00100000:3.0:1787572368.883201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787572368.883217:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268438912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.883327:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268438912:12345-0@lo:400:kworker.0 Request processed in 115us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572368.883355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787572368.883427:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268439424 00000100:00100000:3.0:1787572368.883432:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268439424 00000100:00100000:3.0:1787572368.883477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268439040 00000100:00100000:3.0:1787572368.883480:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268439040 00000100:00100000:3.0:1787572368.883494:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268439168 00000100:00080000:1.0:1787572368.883826:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572368.884332:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268439296 00000100:00100000:1.0:1787572368.884339:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268439296 00000100:00100000:1.0:1787572368.884386:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268439552 00000100:00100000:1.0:1787572368.884391:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268439552 00000100:00100000:1.0:1787572368.884429:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787572368.884439:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268439296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572368.884551:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268439296:12345-0@lo:400:kworker.0 Request processed in 114us (3257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572368.884559:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787572368.884576:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787572368.884582:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268439552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572368.884620:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268439552:12345-0@lo:400:kworker.0 Request processed in 38us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572368.884627:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787572368.886775:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268439168 00000100:00080000:0.0:1787572368.890522:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787572368.890538:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787572368.890541:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787572368.890798:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc8d0380 x1874405268439296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572368.890820:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268439296:0@lo:400:kworker.0 00000100:00100000:0.0:1787572368.890836:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268438912:0@lo:400:kworker.0 00000100:00100000:2.0:1787572368.894894:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787572368.897839:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268439424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572368.897923:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787572368.897947:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268439040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572368.902324:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268439424:12345-0@lo:400:kworker.0 Request processed in 7393us (21078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572368.902415:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787572368.902468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268439168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.902566:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268439168:12345-0@lo:400:kworker.0 Request processed in 139us (21103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572368.902575:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787572368.903078:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268439424:0@lo:400:kworker.0 00000100:00100000:3.0:1787572368.903261:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268439168:0@lo:400:kworker.0 00010000:00080000:3.0:1787572368.903280:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40ed180 x1874405268439552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572368.903293:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268439552:0@lo:400:kworker.0 00000100:00100000:0.0:1787572368.912998:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268439040:12345-0@lo:400:kworker.0 Request processed in 15041us (31622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572368.913047:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787572368.913147:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268439040:0@lo:400:kworker.0 00000100:00100000:2.0:1787572368.914608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000001:00100000:0.0:1787572368.959472:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d6322bb-3191-4d60-88a3-6866da8333ec 00000020:00000080:0.0:1787572368.959482:0:7653:0:(genops.c:885:class_export_put()) final put ffff98d0c52f1800/6d6322bb-3191-4d60-88a3-6866da8333ec 00000020:00000080:3.0:1787572368.959542:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c52f1800/6d6322bb-3191-4d60-88a3-6866da8333ec for lustre-OST0001 00000020:00000080:3.0:1787572368.959596:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c52f5800 for lustre-OST0001 00010000:00010000:2.0:1787572369.203093:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572369.391034:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268439680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572369.391164:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572369.391291:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268439680 00000100:00100000:2.0:1787572369.391304:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268439680 00000100:00100000:2.0:1787572369.391375:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787572369.391386:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268439680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572369.391453:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572369.400163:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268439680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8758us (8980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572369.400188:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787572369.401213:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40ed180 x1874405268439680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572369.401253:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268439680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572369.729004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572369.729097:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244287104 00000100:00100000:1.0:1787572369.729111:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244287104 00000100:00100000:1.0:1787572369.729200:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 89 00000100:00100000:1.0:1787572369.729215:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244287104:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572369.729330:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244287104:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 120us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572369.729339:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 89 00000100:00080000:0.0:1787572369.729542:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572369.731685:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572369.731849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572369.731894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244287232 00000100:00100000:0.0:1787572369.731908:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244287232 00000100:00100000:0.0:1787572369.731990:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:0.0:1787572369.732004:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244287232:12345-192.168.204.55@tcp:400:kworker.0 00000100:00080000:1.0:1787572369.732049:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572369.732108:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244287232:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572369.732116:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:3.0:1787572369.734411:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244286976 00000100:00100000:3.0:1787572369.734431:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244286976 00000100:00100000:3.0:1787572369.734626:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 227 00000100:00100000:3.0:1787572369.734659:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244286976:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572369.734756:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244286976:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 119us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572369.734787:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 227 00000100:00100000:3.0:1787572369.903215:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268439808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572369.903327:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572369.903622:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268439808 00000100:00100000:1.0:1787572369.904032:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268439808 00000100:00100000:1.0:1787572369.907364:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787572369.907398:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268439808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787572369.907445:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572369.908462:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268439808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1081us (5131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572369.908475:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787572369.908559:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43ced80 x1874405268439808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572369.908593:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268439808:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787572369.957752:0:11026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787572370.224231:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572371.247804:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572372.274793:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572373.297487:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572374.002046:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268440320:0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.002149:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572374.002220:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787572374.002228:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268439936:0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.002261:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572374.002284:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268440448:0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.002328:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572374.002359:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268440192:0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.002416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572374.002438:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787572374.002445:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268440064:0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.002472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572374.002503:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268440576:0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.002529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572374.002563:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268440448 00000100:00100000:2.0:1787572374.002573:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268440448 00000100:00100000:2.0:1787572374.002672:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268440192 00000100:00100000:2.0:1787572374.002676:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268440192 00000100:00100000:2.0:1787572374.002978:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268440064 00000100:00100000:2.0:1787572374.002982:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268440064 00000100:00100000:2.0:1787572374.003116:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787572374.003129:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268440448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.003210:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268440448:12345-0@lo:400:kworker.0 Request processed in 84us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572374.003218:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787572374.003247:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787572374.003254:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268440192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.003292:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268440192:12345-0@lo:400:kworker.0 Request processed in 39us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572374.003298:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787572374.003321:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787572374.003327:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268440064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.003356:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268440064:12345-0@lo:400:kworker.0 Request processed in 29us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572374.003363:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787572374.003392:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268440320 00000100:00100000:2.0:1787572374.003397:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268440320 00000100:00100000:2.0:1787572374.003426:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268440576 00000100:00100000:2.0:1787572374.003429:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268440576 00000100:00100000:2.0:1787572374.003445:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787572374.003451:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268440320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.003483:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268440320:12345-0@lo:400:kworker.0 Request processed in 33us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572374.003883:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787572374.003898:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787572374.003906:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268440576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.003941:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268440576:12345-0@lo:400:kworker.0 Request processed in 37us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572374.003947:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787572374.004135:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268440064:0@lo:400:kworker.0 00010000:00080000:2.0:1787572374.004155:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43ced80 x1874405268440576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572374.004176:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268440576:0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.004189:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268440192:0@lo:400:kworker.0 00000100:00100000:2.0:1787572374.004234:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268440448:0@lo:400:kworker.0 00010000:00080000:2.0:1787572374.004248:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43cfb80 x1874405268440320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572374.004257:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268440320:0@lo:400:kworker.0 00000100:00100000:1.0:1787572374.005876:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268439936 00000100:00100000:1.0:1787572374.005890:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268439936 00000100:00100000:1.0:1787572374.005951:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787572374.005962:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268439936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572374.006187:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268439936:12345-0@lo:400:kworker.0 Request processed in 227us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572374.006196:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:1.0:1787572374.006247:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787572374.006253:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787572374.006257:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572374.006341:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268439936:0@lo:400:kworker.0 00000020:00000080:3.0:1787572374.142468:0:11176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc135474c0 20000000:00000080:3.0:1787572374.142494:0:11176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d1d0adc800 uarg=0000000000000000 20000000:01000000:3.0:1787572374.142565:0:11176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787572374.142573:0:11176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787572374.142580:0:11176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787572374.144592:0:11177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787572374.145460:0:11176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787572374.169346:0:11176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787572374.169417:0:11176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169440:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169448:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169456:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169468:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169495:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169505:0:11176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169565:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169584:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 12 pid: 5835 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.169604:0:11176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268440704:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572374.169809:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169818:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 12 pid: 5837 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.169827:0:11176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268440832:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572374.169865:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.169874:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 18 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.169883:0:11176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268440960:0@lo:104: 00000100:00100000:3.0:1787572374.169953:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787572374.170026:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.170035:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 18 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.170044:0:11176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268441088:0@lo:104: 00000100:00100000:3.0:1787572374.170068:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787572374.170097:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.170105:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 18 pid: 5836 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.170114:0:11176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268441216:0@lo:104: 00000100:00100000:3.0:1787572374.170138:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572374.170150:0:11176:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787572374.170992:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268440960 00000100:00100000:0.0:1787572374.171003:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268440960 00000100:00100000:0.0:1787572374.171061:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268441088 00000100:00100000:0.0:1787572374.171065:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268441088 00000100:00100000:0.0:1787572374.171093:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268441216 00000100:00100000:0.0:1787572374.171096:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268441216 00000100:00100000:0.0:1787572374.171112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787572374.171123:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+5:11176:x1874405268440960:12345-0@lo:104: 00010000:00010000:0.0:1787572374.171142:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.171235:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787572374.171242:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+5:11176:x1874405268440960:12345-0@lo:104: Request processed in 121us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572374.171250:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787572374.171269:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787572374.171274:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+4:11176:x1874405268441088:12345-0@lo:104: 00010000:00010000:0.0:1787572374.171283:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.171332:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787572374.171338:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+4:11176:x1874405268441088:12345-0@lo:104: Request processed in 64us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572374.171344:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787572374.171356:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787572374.171362:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:11176:x1874405268441216:12345-0@lo:104: 00010000:00010000:0.0:1787572374.171371:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.171577:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787572374.171584:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+3:11176:x1874405268441216:12345-0@lo:104: Request processed in 221us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572374.171601:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787572374.171630:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787572374.171662:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.171671:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31400 already unused, calling callback (ffffffffc1c36c20) 00000100:00100000:3.0:1787572374.171678:0:11176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268440960:0@lo:104: 10000000:00010000:0.0:1787572374.171678:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.171696:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.171697:0:11176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268441088:0@lo:104: 10000000:00010000:0.0:1787572374.171711:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.171712:0:11176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268441216:0@lo:104: 10000000:01000000:0.0:1787572374.171847:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787572374.171899:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.171907:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572374.171932:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.171939:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31400/0x9fe530ef4f43637d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172036:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787572374.172040:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172056:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572374.172059:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172066:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572374.172072:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572374.172078:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787572374.172092:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172096:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572374.172113:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172120:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1fc276600/0x9fe530ef4f43636f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172129:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572374.172132:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172138:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30c00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572374.172141:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172160:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572374.172167:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572374.172174:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787572374.172195:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172201:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572374.172207:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172214:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30c00/0x9fe530ef4f436361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f436368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172230:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572374.172231:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572374.172233:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572374.172241:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572374.172255:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268441600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787572374.172317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572374.172361:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787572374.172368:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268441472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572374.172395:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572374.172408:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268441344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572374.172444:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572374.172479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572374.172509:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268441600 00000100:00100000:1.0:1787572374.172515:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268441600 00010000:00010000:1.0:1787572374.172546:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 19 pid: 5836 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.172696:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268441344 00000100:00100000:3.0:1787572374.172702:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268441344 00010000:00010000:3.0:1787572374.172722:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 20 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.172738:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268441472 00000100:00100000:3.0:1787572374.172741:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268441472 00010000:00010000:3.0:1787572374.172766:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 21 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.172795:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787572374.172804:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30d720-8336-413c-aa2f-3c1df9a74652+21:3311:x1874405268441600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787572374.172818:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572374.172824:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 21 pid: 5836 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.172836:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 21 pid: 5836 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572374.172839:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787572374.172852:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+21:3312:x1874405268441344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787572374.172860:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f436368 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f436361 expref: 21 pid: 5836 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172869:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572374.172877:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 20 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.172878:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572374.172890:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 20 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172903:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a31600/0x9fe530ef4f436384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43637d expref: 20 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.172913:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572374.172941:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268441600:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572374.172950:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787572374.172958:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3312:x1874405268441344:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572374.172968:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787572374.172992:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787572374.172999:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:3311:x1874405268441472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787572374.173007:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572374.173012:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 17 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.173020:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 17 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.173030:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f436376 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43636f expref: 17 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.173038:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572374.173059:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3311:x1874405268441472:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572374.173073:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787572374.173542:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268441344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572374.173572:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268441472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572374.173580:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268441600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787572374.179833:0:11176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268440704:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572374.183694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572374.183757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572374.184136:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244287488 00000100:00100000:3.0:1787572374.184151:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244287488 00010000:00010000:3.0:1787572374.184220:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 13 pid: 5837 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.184266:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244287360 00000100:00100000:3.0:1787572374.184270:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244287360 00010000:00010000:3.0:1787572374.184283:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 14 pid: 5835 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572374.184320:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:3.0:1787572374.184349:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46025283-1dc6-4449-aad9-047e59682663+14:2353:x1874405244287488:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572374.184368:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572374.184375:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 14 pid: 5837 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184388:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 14 pid: 5837 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184413:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572374.184479:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46025283-1dc6-4449-aad9-047e59682663+14:2353:x1874405244287488:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 132us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572374.184487:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:3.0:1787572374.184509:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:3.0:1787572374.184515:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244287360:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572374.184525:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572374.184530:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 13 pid: 5835 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184539:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 13 pid: 5835 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184551:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a30e00/0x9fe530ef4f4363a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e7 expref: 13 pid: 5835 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184569:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184578:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184601:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184608:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184614:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184621:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184627:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572374.184631:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184861:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184872:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572374.184884:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572374.187270:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46025283-1dc6-4449-aad9-047e59682663+12:2353:x1874405244287360:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 2735us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572374.187287:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00010000:00010000:2.0:1787572374.188060:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43638b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db8af expref: 11 pid: 5837 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572374.188086:0:11176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1874405268440832:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572374.188234:0:11176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572374.188249:0:11176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572374.188656:0:11176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572374.188666:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f4363bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572374.320493:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572374.511371:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572374.511395:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268441728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572374.511462:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572374.511590:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268441728 00000100:00100000:3.0:1787572374.511599:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268441728 00000100:00100000:3.0:1787572374.511672:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787572374.511683:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268441728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572374.511725:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572374.511788:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268441728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572374.511795:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787572374.511956:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40ee300 x1874405268441728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572374.511987:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268441728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572374.846243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572374.846311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572374.846467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572374.846752:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244287616 00000100:00100000:2.0:1787572374.846767:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244287616 00000100:00100000:2.0:1787572374.846839:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 229 00000100:00100000:2.0:1787572374.846851:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+11:2354:x1874405244287616:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572374.846945:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+11:2354:x1874405244287616:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 97us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572374.846954:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 229 00000100:00100000:0.0:1787572374.851867:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244287872 00000100:00100000:0.0:1787572374.851891:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244287872 00000100:00100000:0.0:1787572374.852562:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244287744 00000100:00100000:0.0:1787572374.852568:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244287744 00000100:00100000:3.0:1787572374.852659:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:3.0:1787572374.852675:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244287872:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572374.852797:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244287872:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 127us (6485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572374.852805:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00080000:1.0:1787572374.856690:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572374.857745:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:0.0:1787572374.857765:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244287744:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572374.857893:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244287744:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 135us (11425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572374.857902:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:2.0:1787572375.024621:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572375.024667:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268441856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572375.024774:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572375.024860:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268441856 00000100:00100000:2.0:1787572375.024870:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268441856 00000100:00100000:2.0:1787572375.024932:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787572375.024943:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268441856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572375.025008:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572375.025062:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268441856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572375.025070:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787572375.025136:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4ed180 x1874405268441856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572375.025157:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268441856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572375.231213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572375.231471:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244288000 00000100:00100000:1.0:1787572375.231486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244288000 00000100:00100000:1.0:1787572375.231561:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 230 00000100:00100000:1.0:1787572375.231575:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+11:5597:x1874405244288000:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787572375.231597:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572375.231623:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db911 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.231690:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.231714:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.231726:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c9a00, rc 0) 00000100:00100000:1.0:1787572375.231801:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244288000:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 229us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572375.231810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 230 00000100:00100000:3.0:1787572375.249711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572375.250836:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244288128 00000100:00100000:1.0:1787572375.250869:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244288128 00000100:00100000:1.0:1787572375.250963:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 231 00000100:00100000:1.0:1787572375.250978:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244288128:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787572375.251395:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244288128:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 419us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572375.251404:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 231 00000100:00100000:3.0:1787572375.259064:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572375.259832:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244288256 00000100:00100000:2.0:1787572375.259864:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244288256 00000100:00100000:2.0:1787572375.259945:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 232 00000100:00100000:2.0:1787572375.259959:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244288256:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.260287:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244288256:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 321us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572375.260296:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 232 00000100:00100000:3.0:1787572375.271626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572375.277200:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244288384 00000100:00100000:0.0:1787572375.277222:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244288384 00000100:00100000:0.0:1787572375.277333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 233 00000100:00100000:0.0:1787572375.277349:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244288384:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572375.277375:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572375.277400:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db918 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572375.277437:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572375.277449:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572375.277461:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a31e00, rc 0) 00000100:00100000:0.0:1787572375.277557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244288384:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 211us (5946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572375.277584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 233 10000000:01000000:0.0:1787572375.279611:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787572375.279619:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1d0ba8000 from 7 10000000:01000000:0.0:1787572375.279626:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787572375.279709:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572375.279734:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572375.279747:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572375.279779:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268441984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787572375.279860:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572375.279933:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1ead3cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787572375.280298:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268441984 00000100:00100000:1.0:1787572375.280310:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268441984 00000100:00100000:1.0:1787572375.280384:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787572375.280397:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268441984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787572375.280414:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572375.280431:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4363d1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.280459:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.280470:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.280480:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8c00, rc 0) 00000100:00100000:1.0:1787572375.280540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268441984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572375.280547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787572375.280715:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268441984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572375.280744:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572375.280754:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572375.280825:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572375.280857:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572375.280907:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787572375.281117:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268442112 00000100:00100000:0.0:1787572375.281121:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268442112 00000100:00100000:0.0:1787572375.281148:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787572375.281155:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268442112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572375.281524:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268442112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 368us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572375.281532:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787572375.281753:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572375.281799:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572375.281845:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572375.281872:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787572375.282056:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268442240 00000100:00100000:2.0:1787572375.282063:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268442240 00000100:00100000:2.0:1787572375.282100:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787572375.282108:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268442240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.282318:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268442240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572375.282327:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787572375.282376:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572375.285910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000040:00080000:3.0:1787572375.286841:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:0.0:1787572375.287084:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244288512 00000100:00100000:0.0:1787572375.287099:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244288512 00000100:00100000:0.0:1787572375.287180:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 237 00000100:00100000:0.0:1787572375.287193:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244288512:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572375.287772:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244288512:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 579us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572375.287782:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 237 00000020:01000000:1.0:1787572375.289352:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787572375.289405:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787572375.289420:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.289452:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572375.289467:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787572375.289470:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1cebea800 from 7 10000000:01000000:1.0:1787572375.289473:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787572375.289524:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.289532:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.289545:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572375.289574:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787572375.289703:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572375.289748:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572375.290148:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268442368 00000100:00100000:2.0:1787572375.290159:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268442368 00000100:00100000:2.0:1787572375.290232:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787572375.290244:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268442368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572375.290261:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572375.290287:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4363df expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572375.290319:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572375.290332:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572375.290343:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277e00, rc 0) 00000100:00100000:2.0:1787572375.290414:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268442368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572375.290422:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787572375.292442:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787572375.292476:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.292490:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572375.292593:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787572375.292696:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572375.292769:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572375.292797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268442496 00000100:00100000:1.0:1787572375.292805:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268442496 00000100:00100000:1.0:1787572375.292863:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787572375.292873:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268442496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.293537:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572375.294128:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244288640 00000100:00100000:3.0:1787572375.294137:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244288640 00000100:00100000:3.0:1787572375.294526:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 240 00000100:00100000:3.0:1787572375.294540:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244288640:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572375.294855:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244288640:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 318us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572375.294864:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 240 00000100:00100000:1.0:1787572375.296381:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268442496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3500us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572375.296395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787572375.296615:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.296716:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.296774:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572375.310404:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada000 going to sleep for 11 seconds 00000100:00100000:0.0:1787572375.313377:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268442624 00000100:00100000:0.0:1787572375.313401:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268442624 00000100:00100000:0.0:1787572375.313497:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787572375.313512:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268442624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572375.313899:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268442624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 389us (17123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572375.313907:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787572375.313960:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787572375.317534:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787572375.318097:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787572375.318129:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787572375.318146:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572375.318437:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572375.318454:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787572375.318458:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1c4a88000 from 7 10000000:01000000:2.0:1787572375.318462:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787572375.318525:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572375.318535:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572375.318550:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572375.318609:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.319240:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572375.319314:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada000 going to sleep for 11 seconds 00000100:00100000:0.0:1787572375.319342:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268442752 00000100:00100000:0.0:1787572375.319352:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268442752 00000100:00100000:0.0:1787572375.319422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787572375.319435:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268442752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572375.319457:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572375.319476:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4363ed expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572375.319511:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572375.319525:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572375.319536:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a31400, rc 0) 00000100:00100000:0.0:1787572375.319601:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268442752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572375.319625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787572375.319874:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572375.319892:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572375.319903:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572375.320305:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.320343:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572375.320823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268442880 00000100:00100000:1.0:1787572375.320831:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268442880 00000100:00100000:2.0:1787572375.321741:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada000 going to sleep for 11 seconds 00000100:00100000:1.0:1787572375.322115:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787572375.322136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268442880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787572375.322560:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268442880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572375.322569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787572375.322684:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268442880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.322756:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268443008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572375.322810:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572375.329040:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada000 going to sleep for 11 seconds 00000100:00100000:1.0:1787572375.333666:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268443008 00000100:00100000:1.0:1787572375.333688:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268443008 00000100:00100000:1.0:1787572375.335085:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787572375.335105:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268443008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572375.336927:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268443008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1816us (14103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572375.337116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787572375.337399:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268443008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787572375.338880:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787572375.339069:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787572375.339098:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787572375.339113:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.339127:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572375.344947:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572376.366902:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572377.411379:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572378.419787:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572379.126655:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268443136:0@lo:400:kworker.0 00000100:00100000:0.0:1787572379.126660:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268443520:0@lo:400:kworker.0 00000100:00100000:2.0:1787572379.134596:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572379.134708:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268443648:0@lo:400:kworker.0 00000100:00100000:2.0:1787572379.137387:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572379.137489:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787572379.137505:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268443264:0@lo:400:kworker.0 00000100:00100000:2.0:1787572379.137563:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572379.137584:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268443776:0@lo:400:kworker.0 00000100:00100000:2.0:1787572379.137612:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572379.137692:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268443392:0@lo:400:kworker.0 00000100:00100000:2.0:1787572379.137721:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572379.138123:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268443136 00000100:00100000:1.0:1787572379.138135:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268443136 00000100:00100000:1.0:1787572379.138216:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787572379.138229:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268443136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572379.138316:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268443136:12345-0@lo:400:kworker.0 Request processed in 90us (3734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572379.138325:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787572379.139530:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268443648 00000100:00100000:2.0:1787572379.139544:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268443648 00000100:00100000:0.0:1787572379.139568:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572379.139597:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268443264 00000100:00100000:2.0:1787572379.139601:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268443264 00000100:00100000:2.0:1787572379.139618:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268443392 00000100:00100000:2.0:1787572379.139620:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268443392 00000100:00100000:2.0:1787572379.139650:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787572379.139662:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268443648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572379.139699:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787572379.139709:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268443264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572379.139717:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268443648:12345-0@lo:400:kworker.0 Request processed in 59us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572379.139754:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268443264:12345-0@lo:400:kworker.0 Request processed in 47us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572379.139918:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268443264:0@lo:400:kworker.0 00000100:00100000:1.0:1787572379.139934:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268443136:0@lo:400:kworker.0 00000100:00100000:1.0:1787572379.139946:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268443648:0@lo:400:kworker.0 00000100:00080000:1.0:1787572379.139976:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572379.140524:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787572379.140582:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787572379.140602:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787572379.140612:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268443392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572379.140705:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268443392:12345-0@lo:400:kworker.0 Request processed in 95us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572379.140712:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787572379.140845:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268443776 00000100:00100000:2.0:1787572379.140852:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268443776 00000100:00100000:2.0:1787572379.140896:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268443520 00000100:00100000:2.0:1787572379.140899:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268443520 00000100:00100000:2.0:1787572379.140916:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787572379.140923:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268443776:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787572379.140954:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572379.140958:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787572379.140966:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268443776:12345-0@lo:400:kworker.0 Request processed in 43us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572379.140972:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787572379.140983:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787572379.141989:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268443520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572379.142064:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268443520:12345-0@lo:400:kworker.0 Request processed in 86us (2496us total) trans 0 rc 0/0 00010000:00080000:1.0:1787572379.142656:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4ed500 x1874405268443776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572379.142679:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268443776:0@lo:400:kworker.0 00000100:00100000:2.0:1787572379.163167:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787572379.163368:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268443392:0@lo:400:kworker.0 00010000:00080000:2.0:1787572379.163429:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4ef480 x1874405268443520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572379.163442:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268443520:0@lo:400:kworker.0 00010000:00010000:1.0:1787572379.442779:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787572379.607164:0:11374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787572379.633933:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787572379.633969:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268443904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572379.634073:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572379.634748:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268443904 00000100:00100000:3.0:1787572379.634759:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268443904 00000100:00100000:3.0:1787572379.634824:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787572379.634838:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268443904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572379.634889:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572379.634964:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268443904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572379.634971:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787572379.635035:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40ee300 x1874405268443904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572379.635085:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268443904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572379.987542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572379.987607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572379.987670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572379.988024:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244289024 00000100:00100000:0.0:1787572379.988038:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244289024 00000100:00100000:0.0:1787572379.988120:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244288896 00000100:00100000:0.0:1787572379.988124:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244288896 00000100:00100000:0.0:1787572379.988154:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:0.0:1787572379.988178:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244289024:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572379.988482:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244289024:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 306us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572379.988491:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:0.0:1787572379.988514:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:0.0:1787572379.988522:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244288896:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572379.988550:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244288896:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 30us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572379.988556:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00080000:0.0:1787572379.988580:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572379.989015:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244288768 00000100:00100000:1.0:1787572379.989022:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244288768 00000100:00100000:1.0:1787572379.989061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 246 00000100:00100000:1.0:1787572379.989069:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244288768:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572379.989114:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244288768:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 46us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572379.989121:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 246 00000100:00100000:3.0:1787572380.143112:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268444032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572380.143252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572380.143422:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268444032 00000100:00100000:3.0:1787572380.143436:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268444032 00000100:00100000:3.0:1787572380.143517:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787572380.143531:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268444032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787572380.143594:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572380.143688:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268444032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572380.143698:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787572380.143751:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4ef480 x1874405268444032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572380.143776:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268444032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787572380.466781:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572381.487319:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572382.515921:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572383.535002:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572384.239066:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268444160:0@lo:400:kworker.0 00000100:00100000:0.0:1787572384.239128:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268444416:0@lo:400:kworker.0 00000100:00100000:2.0:1787572384.239173:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572384.244790:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268444544:0@lo:400:kworker.0 00000100:00100000:3.0:1787572384.246071:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268444288:0@lo:400:kworker.0 00000100:00100000:0.0:1787572384.248646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572384.248725:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268444416 00000100:00100000:0.0:1787572384.248736:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268444416 00000100:00100000:0.0:1787572384.248800:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787572384.248812:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268444416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572384.248894:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268444416:12345-0@lo:400:kworker.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572384.248901:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1787572384.248952:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572384.249006:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268444416:0@lo:400:kworker.0 00000100:00100000:2.0:1787572384.251591:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268444672:0@lo:400:kworker.0 00000100:00100000:2.0:1787572384.251674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572384.251762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268444672 00000100:00100000:2.0:1787572384.251770:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268444672 00000100:00100000:2.0:1787572384.251837:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787572384.251847:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268444672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572384.251895:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268444672:12345-0@lo:400:kworker.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572384.251903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787572384.251929:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268444160 00000100:00100000:2.0:1787572384.251933:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268444160 00000100:00100000:2.0:1787572384.251967:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787572384.251974:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268444160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572384.252004:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268444160:12345-0@lo:400:kworker.0 Request processed in 31us (12835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572384.252026:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1787572384.252054:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572384.252094:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268444672:0@lo:400:kworker.0 00000100:00100000:2.0:1787572384.252115:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268444160:0@lo:400:kworker.0 00000100:00100000:1.0:1787572384.260091:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572384.260284:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268444544 00000100:00100000:2.0:1787572384.260296:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268444544 00000100:00100000:2.0:1787572384.260360:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787572384.260370:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268444544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572384.260411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572384.260425:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268444544:12345-0@lo:400:kworker.0 Request processed in 57us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572384.260432:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787572384.260436:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268444800:0@lo:400:kworker.0 00000100:00100000:3.0:1787572384.260463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572384.260513:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268444288 00000100:00100000:3.0:1787572384.260516:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268444288 00000100:00100000:3.0:1787572384.260545:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787572384.260551:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268444288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572384.260587:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268444288:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572384.260607:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787572384.260661:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787572384.260665:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268444288:0@lo:400:kworker.0 00010000:00080000:1.0:1787572384.260682:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1d0b74a80 x1874405268444544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572384.260693:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268444544:0@lo:400:kworker.0 00000100:00100000:2.0:1787572384.260752:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268444800 00000100:00100000:2.0:1787572384.260756:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268444800 00000100:00100000:2.0:1787572384.260795:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787572384.260801:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268444800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572384.260837:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268444800:12345-0@lo:400:kworker.0 Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572384.260843:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787572384.260906:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1d0b77b80 x1874405268444800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572384.260915:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268444800:0@lo:400:kworker.0 00000100:00080000:1.0:1787572384.260976:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787572384.558784:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787572384.734945:0:11473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:53:01 (1787572381) === 00000100:00100000:3.0:1787572384.756303:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572384.756328:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268444928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572384.756404:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572384.758550:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268444928 00000100:00100000:2.0:1787572384.758560:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268444928 00000100:00100000:2.0:1787572384.758625:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787572384.758664:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268444928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572384.758707:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572384.758781:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268444928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572384.758801:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787572384.759701:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1fc4efb80 x1874405268444928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572384.759725:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268444928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572385.037004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572385.037066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572385.037201:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244289280 00000100:00100000:3.0:1787572385.037212:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244289280 00000100:00100000:3.0:1787572385.037278:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1787572385.037290:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:9681:x1874405244289280:12345-192.168.204.55@tcp:700:mkdir.0 00000100:00100000:3.0:1787572385.037374:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:9681:x1874405244289280:12345-192.168.204.55@tcp:700:mkdir.0 Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572385.037381:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00080000:1.0:1787572385.037542:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572385.038271:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244289152 00000100:00100000:0.0:1787572385.038280:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244289152 00000100:00100000:0.0:1787572385.038362:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:0.0:1787572385.038372:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244289152:12345-192.168.204.55@tcp:41:mkdir.0 00000004:00000024:0.0:1787572385.038419:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787572385.038493:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244289152:12345-192.168.204.55@tcp:41:mkdir.0 Request processed in 123us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572385.038501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:2.0:1787572385.040832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572385.041052:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244289536 00000100:00100000:3.0:1787572385.041062:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244289536 00000100:00100000:3.0:1787572385.041131:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:3.0:1787572385.041142:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:9681:x1874405244289536:12345-192.168.204.55@tcp:36:mkdir.0 00010000:00010000:3.0:1787572385.041196:0:7555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572385.041271:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d206279000/0x9fe530ef4f4362dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db89a expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.041294:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1c3a46000) 00010000:00010000:3.0:1787572385.041318:0:7555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572385.041908:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.041923:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.042008:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.044339:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.044361:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.044372:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572385.047265:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787572385.047285:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.047296:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.047304:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.047310:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572385.047314:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.047321:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.047338:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1c577ce00) 00010000:00010000:2.0:1787572385.047341:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572385.047345:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.047351:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4363fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787572385.047373:0:7555:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e17ed39a reply state 000000009f595272 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572385.047393:0:7555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572385.047570:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:9681:x1874405244289536:12345-192.168.204.55@tcp:36:mkdir.0 Request processed in 6425us (6739us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787572385.047580:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00010000:00010000:1.0:1787572385.051696:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.051714:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.051722:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.051743:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572385.051747:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.051754:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.051773:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98d1c577c600) 00010000:00010000:1.0:1787572385.051775:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572385.051780:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.051785:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436402 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572385.058551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.058735:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244289664 00000100:00100000:0.0:1787572385.058746:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244289664 00000100:00100000:1.0:1787572385.058845:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:1.0:1787572385.058857:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:9682:x1874405244289664:12345-192.168.204.55@tcp:101:chmod.0 00010000:00010000:1.0:1787572385.058880:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572385.058903:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f436409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db91f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.058980:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436410 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.058994:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.059005:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572385.059099:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787572385.059104:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572385.059153:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.059187:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f436409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db91f expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.059205:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db91f expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.059213:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:1.0:1787572385.059216:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572385.059220:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0031000, rc 0) 00000100:00100000:1.0:1787572385.059290:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:9682:x1874405244289664:12345-192.168.204.55@tcp:101:chmod.0 Request processed in 434us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572385.059298:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:2.0:1787572385.063400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.063496:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244289920 00000100:00100000:0.0:1787572385.063506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244289920 00000100:00100000:0.0:1787572385.063600:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:0.0:1787572385.063612:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:9682:x1874405244289920:12345-192.168.204.55@tcp:36:chmod.0 00010000:00010000:0.0:1787572385.063695:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572385.063724:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436410 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db91f expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.063741:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:0.0:1787572385.063753:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572385.063777:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.063789:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.063814:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787572385.064164:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055ce6718 reply state 000000005a2b665f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572385.064174:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787572385.064195:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787572385.064284:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:9682:x1874405244289920:12345-192.168.204.55@tcp:36:chmod.0 Request processed in 674us (896us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787572385.064291:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00010000:00010000:2.0:1787572385.067781:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.067799:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.067808:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.067814:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572385.067819:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.067827:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.067844:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1e1353c00) 00010000:00010000:2.0:1787572385.067847:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787572385.067852:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.067858:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f436417 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572385.086437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572385.086531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572385.086625:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244290048 00000100:00100000:1.0:1787572385.086676:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244290048 00000100:00100000:1.0:1787572385.086726:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 248 00000100:00100000:1.0:1787572385.086737:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244290048:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572385.086824:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244290048:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 89us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572385.086832:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 248 00000100:00100000:0.0:1787572385.087510:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244290176 00000100:00100000:0.0:1787572385.087516:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244290176 00000100:00100000:0.0:1787572385.087589:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:0.0:1787572385.087598:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244290176:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572385.087681:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244290176:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 84us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572385.087689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00080000:1.0:1787572385.087883:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572385.094928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.095149:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244290304 00000100:00100000:0.0:1787572385.095160:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244290304 00000100:00100000:0.0:1787572385.095262:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:0.0:1787572385.095274:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:9683:x1874405244290304:12345-192.168.204.55@tcp:101:chown.0 00010000:00010000:0.0:1787572385.095301:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572385.095325:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f43641e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db926 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.095392:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30a00/0x9fe530ef4f436425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.095405:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30a00/0x9fe530ef4f436425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.095414:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30a00/0x9fe530ef4f436425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572385.095480:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787572385.095498:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572385.095552:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30a00/0x9fe530ef4f436425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.095583:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f43641e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db926 expref: 9 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.095602:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30a00/0x9fe530ef4f436425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db926 expref: 8 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.095611:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1e1353000) 00010000:00010000:0.0:1787572385.095614:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572385.095617:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30a00, rc 0) 00000100:00100000:2.0:1787572385.096043:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:9683:x1874405244290304:12345-192.168.204.55@tcp:101:chown.0 Request processed in 769us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572385.096052:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:3.0:1787572385.098995:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.099162:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244290432 00000100:00100000:0.0:1787572385.099173:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244290432 00000100:00100000:0.0:1787572385.099233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:0.0:1787572385.099242:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:9683:x1874405244290432:12345-192.168.204.55@tcp:101:chown.0 00010000:00010000:0.0:1787572385.099263:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572385.099284:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30600/0x9fe530ef4f43642c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db92d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099347:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099361:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099370:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099404:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099411:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099418:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099517:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f436441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099525:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f436441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099533:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f436441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572385.099585:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787572385.099589:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572385.099613:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f436441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099625:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099631:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099680:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099694:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.099699:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099707:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099720:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1e1353000) 00010000:00010000:0.0:1787572385.099723:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.099727:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099733:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099747:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099752:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099757:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099761:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.099763:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099769:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.099785:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98d1e1353300) 00010000:00010000:0.0:1787572385.099788:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.099790:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.100140:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f43643a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.100177:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30600/0x9fe530ef4f43642c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db92d expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.100192:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f436441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db92d expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.100199:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1e1353900) 00010000:00010000:0.0:1787572385.100201:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572385.100203:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30e00, rc 0) 00000100:00100000:0.0:1787572385.100305:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:9683:x1874405244290432:12345-192.168.204.55@tcp:101:chown.0 Request processed in 1062us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572385.100312:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:3.0:1787572385.104054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.104264:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244290688 00000100:00100000:0.0:1787572385.104274:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244290688 00000100:00100000:0.0:1787572385.104378:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:0.0:1787572385.104390:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:9683:x1874405244290688:12345-192.168.204.55@tcp:36:chown.0 00010000:00010000:0.0:1787572385.104446:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572385.104475:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f436441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db92d expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.104513:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1e1353900) 00010000:00010000:0.0:1787572385.104524:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572385.104564:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.104578:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.104588:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572385.141129:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787572385.141592:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1c13df2 reply state 00000000ed94d401 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572385.141608:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787572385.141960:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1787572385.142111:0:5842:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787572385.142134:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:9683:x1874405244290688:12345-192.168.204.55@tcp:36:chown.0 Request processed in 37742us (38086us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787572385.142143:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00010000:00010000:1.0:1787572385.142292:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.142310:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.142318:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.142324:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572385.142329:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.142337:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.142354:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1e1353700) 00010000:00010000:1.0:1787572385.142357:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787572385.142362:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.142368:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f436448 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572385.164193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572385.164352:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244290816 00000100:00100000:2.0:1787572385.164362:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244290816 00000100:00100000:2.0:1787572385.164425:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1787572385.164436:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:9684:x1874405244290816:12345-192.168.204.55@tcp:101:touch.500 00010000:00010000:2.0:1787572385.164462:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572385.164483:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277000/0x9fe530ef4f43644f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db934 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787572385.165695:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1159us 00010000:00010000:2.0:1787572385.187197:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.187221:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.187233:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.187248:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.187266:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.187273:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.187688:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.187697:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.187705:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572385.187771:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787572385.187774:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572385.188492:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188506:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188512:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188518:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188523:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572385.188527:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188540:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188552:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1e1353000) 00010000:00010000:2.0:1787572385.188555:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572385.188560:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188566:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188578:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188584:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188589:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188593:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572385.188595:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188600:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188605:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572385.188607:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572385.188610:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188623:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276c00/0x9fe530ef4f43645d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188692:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277000/0x9fe530ef4f43644f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db934 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188706:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db934 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.188714:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1c3a46600) 00010000:00010000:2.0:1787572385.188716:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787572385.188718:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277400, rc 0) 00000100:00100000:2.0:1787572385.188786:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:9684:x1874405244290816:12345-192.168.204.55@tcp:101:touch.500 Request processed in 24350us (24604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572385.195303:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1787572385.197910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.198350:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244291072 00000100:00100000:0.0:1787572385.198360:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244291072 00000100:00100000:0.0:1787572385.198427:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:0.0:1787572385.198439:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:9684:x1874405244291072:12345-192.168.204.55@tcp:101:touch.500 00010000:00010000:0.0:1787572385.198460:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572385.198482:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30600/0x9fe530ef4f43646b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db93b expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.198987:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.199004:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.199015:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.199030:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.199037:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.199290:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787572385.205381:0:7555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787572385.205995:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f436480 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206012:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f436480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206024:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f436480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206274:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206294:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206300:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206306:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.206310:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206318:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206329:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1c3a46600) 00010000:00010000:0.0:1787572385.206332:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.206336:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206341:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f436472 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787572385.206355:0:7555:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d796791c reply state 00000000d2c17dd6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572385.206364:0:7555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787572385.206407:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30600/0x9fe530ef4f43646b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db93b expref: 10 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206421:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f436480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db93b expref: 9 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.206439:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:0.0:1787572385.206441:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572385.206444:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30c00, rc 0) 00000100:00100000:0.0:1787572385.206674:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:9684:x1874405244291072:12345-192.168.204.55@tcp:101:touch.500 Request processed in 8236us (8770us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787572385.206682:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00010000:00010000:1.0:1787572385.212593:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.212614:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.212622:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.212628:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572385.212681:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.212690:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.212710:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff98d1e1353900) 00010000:00010000:1.0:1787572385.212713:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572385.212718:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.212724:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f436479 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572385.215194:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572385.215885:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244291328 00000100:00100000:3.0:1787572385.215895:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244291328 00000100:00100000:3.0:1787572385.215971:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:3.0:1787572385.215982:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:9684:x1874405244291328:12345-192.168.204.55@tcp:36:touch.500 00010000:00010000:3.0:1787572385.216046:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572385.216082:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f436480 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db93b expref: 9 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.216113:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:3.0:1787572385.216137:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572385.216195:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.216209:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.216219:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787572385.216360:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9d36e7f reply state 0000000097f5fe22 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572385.216370:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787572385.216456:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:9684:x1874405244291328:12345-192.168.204.55@tcp:36:touch.500 Request processed in 475us (1272us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787572385.216463:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:1.0:1787572385.221273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:2.0:1787572385.221736:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.221752:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.221760:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.221766:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572385.221772:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.221796:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.222373:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d1c577ca00) 00010000:00010000:2.0:1787572385.222376:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572385.222382:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572385.222388:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43648e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572385.222617:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244291456 00000100:00100000:3.0:1787572385.222629:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244291456 00000100:00100000:3.0:1787572385.222898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:3.0:1787572385.222910:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:9684:x1874405244291456:12345-192.168.204.55@tcp:101:touch.500 00010000:00010000:3.0:1787572385.222945:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572385.222965:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436495 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db942 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.223024:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db942 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.223036:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db942 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.223342:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d1c577c800) 00010000:00010000:3.0:1787572385.223345:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572385.223348:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eac00, rc 0) 00000100:00100000:3.0:1787572385.223415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:9684:x1874405244291456:12345-192.168.204.55@tcp:101:touch.500 Request processed in 507us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572385.223422:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:3.0:1787572385.227399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572385.227553:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244291584 00000100:00100000:1.0:1787572385.227563:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244291584 00000100:00100000:1.0:1787572385.227608:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:1.0:1787572385.227616:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874405244291584:12345-192.168.204.55@tcp:8:touch.500 00010000:00080000:1.0:1787572385.227666:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:1.0:1787572385.227695:0:6690:0:(genops.c:1385:class_connect()) connect: client 6d499b5b-e864-4e70-bf3c-7c3a42e124cd, cookie 0x9fe530ef4f43649c 00002000:00100000:1.0:1787572385.227708:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d499b5b-e864-4e70-bf3c-7c3a42e124cd/ffff98d1f4171800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787572385.227719:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787572385.227948:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787572385.227974:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d1f4170800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787572385.228032:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2352:x1874405244291584:12345-192.168.204.55@tcp:8:touch.500 Request processed in 415us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572385.228786:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:1.0:1787572385.230988:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.231930:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244291712 00000100:00100000:0.0:1787572385.231942:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244291712 00000100:00100000:0.0:1787572385.232074:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:0.0:1787572385.232096:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:0:x1874405244291712:12345-192.168.204.55@tcp:2:touch.500 00000100:00080000:1.0:1787572385.237902:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572385.265546:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572385.265573:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268445056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572385.265655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572385.265978:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268445056 00000100:00100000:2.0:1787572385.265986:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268445056 00000100:00100000:2.0:1787572385.266043:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787572385.266069:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268445056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572385.266116:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1787572385.266403:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43ce680 x1874405268445056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572385.266424:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268445056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572385.266477:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268445056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 417us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572385.266485:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787572385.282553:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:0:x1874405244291712:12345-192.168.204.55@tcp:2:touch.500 Request processed in 50457us (51561us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787572385.282568:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000001:00080000:0.0:1787572385.282606:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1787572385.282619:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000100:00100000:0.0:1787572385.287872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572385.287949:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244291968 00000100:00100000:3.0:1787572385.287958:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244291968 00000100:00100000:3.0:1787572385.288063:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:3.0:1787572385.288075:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:9684:x1874405244291968:12345-192.168.204.55@tcp:35:touch.500 00000100:00100000:3.0:1787572385.288419:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:9684:x1874405244291968:12345-192.168.204.55@tcp:35:touch.500 Request processed in 346us (554us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787572385.288427:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1787572385.306546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572385.306753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244292096 00000100:00100000:3.0:1787572385.306763:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244292096 00000100:00100000:3.0:1787572385.306830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:3.0:1787572385.306841:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:9685:x1874405244292096:12345-192.168.204.55@tcp:101:rm.0 00010000:00010000:3.0:1787572385.306865:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572385.306886:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f4364a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db949 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.306967:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4364aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.306991:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4364aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.307002:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4364aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572385.307299:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787572385.307303:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572385.307350:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4364aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.307377:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f4364a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db949 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.307394:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4364aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db949 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.307402:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1c3a46600) 00010000:00010000:3.0:1787572385.307405:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787572385.307408:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb600, rc 0) 00000100:00100000:3.0:1787572385.307526:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+12:9685:x1874405244292096:12345-192.168.204.55@tcp:101:rm.0 Request processed in 686us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572385.307593:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:1.0:1787572385.316412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.316523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244292352 00000100:00100000:0.0:1787572385.316543:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244292352 00000100:00100000:0.0:1787572385.316608:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:0.0:1787572385.316618:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+12:9685:x1874405244292352:12345-192.168.204.55@tcp:101:rm.0 00010000:00010000:0.0:1787572385.316682:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572385.316703:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db950 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572385.316833:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787572385.316962:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db950 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.316977:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1e1353000) 00010000:00010000:0.0:1787572385.316980:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572385.316985:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db950 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.316998:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30c00, rc 0) 00000100:00100000:0.0:1787572385.317055:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:9685:x1874405244292352:12345-192.168.204.55@tcp:101:rm.0 Request processed in 438us (655us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787572385.317063:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:0.0:1787572385.325895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572385.326005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244292480 00000100:00100000:2.0:1787572385.326015:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244292480 00000100:00100000:2.0:1787572385.326099:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:2.0:1787572385.326110:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:9685:x1874405244292480:12345-192.168.204.55@tcp:37:rm.0 00000100:00100000:2.0:1787572385.333590:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:9685:x1874405244292480:12345-192.168.204.55@tcp:37:rm.0 Request processed in 7469us (7692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572385.333603:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:1.0:1787572385.339103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572385.339505:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244292736 00000100:00100000:3.0:1787572385.339517:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244292736 00000100:00100000:3.0:1787572385.339588:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:3.0:1787572385.339599:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7482850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:9685:x1874405244292736:12345-192.168.204.55@tcp:35:rm.0 00000100:00100000:3.0:1787572385.339913:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7482850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:9685:x1874405244292736:12345-192.168.204.55@tcp:35:rm.0 Request processed in 315us (835us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787572385.339933:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:0.0:1787572385.344951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572385.345051:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244292992 00000100:00100000:3.0:1787572385.345069:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244292992 00000100:00100000:3.0:1787572385.345139:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:3.0:1787572385.345151:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:9685:x1874405244292992:12345-192.168.204.55@tcp:101:rm.0 00010000:00010000:3.0:1787572385.345391:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572385.345413:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f4364bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db957 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.345555:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4364c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.345570:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4364c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.345582:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4364c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572385.345593:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787572385.345798:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f4364bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db957 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.345818:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4364c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db957 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572385.345827:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1c3a46600) 00010000:00010000:3.0:1787572385.345830:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787572385.345833:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eaa00, rc 0) 00000100:00100000:3.0:1787572385.345910:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:9685:x1874405244292992:12345-192.168.204.55@tcp:101:rm.0 Request processed in 760us (979us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787572385.345917:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:1.0:1787572385.350725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.351093:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244293120 00000100:00100000:0.0:1787572385.351104:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244293120 00000100:00100000:0.0:1787572385.351324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:0.0:1787572385.351337:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:9685:x1874405244293120:12345-192.168.204.55@tcp:41:rm.0 00000004:00000024:0.0:1787572385.351415:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787572385.351496:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:9685:x1874405244293120:12345-192.168.204.55@tcp:41:rm.0 Request processed in 162us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572385.351504:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:1.0:1787572385.356011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.356196:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244293248 00000100:00100000:0.0:1787572385.356207:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244293248 00000100:00100000:0.0:1787572385.356267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:0.0:1787572385.356279:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:9685:x1874405244293248:12345-192.168.204.55@tcp:101:rm.0 00010000:00010000:0.0:1787572385.356299:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572385.356319:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30600/0x9fe530ef4f4364d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356381:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356395:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356406:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356421:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356428:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356435:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356572:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f4364e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356580:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f4364e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356587:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f4364e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572385.356612:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787572385.356616:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572385.356632:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f4364e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356682:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f4364e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356690:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356697:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356703:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356708:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.356712:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356719:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356735:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1c3a46600) 00010000:00010000:0.0:1787572385.356738:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.356742:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356748:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31800/0x9fe530ef4f4364db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356762:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356767:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356773:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356778:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.356780:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356786:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356805:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff98d1e1353400) 00010000:00010000:0.0:1787572385.356807:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.356809:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356814:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f4364e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356855:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30600/0x9fe530ef4f4364d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db95e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356868:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f4364e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db95e expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.356875:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d1c577c800) 00010000:00010000:0.0:1787572385.356877:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572385.356879:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30200, rc 0) 00000100:00100000:0.0:1787572385.356944:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:9685:x1874405244293248:12345-192.168.204.55@tcp:101:rm.0 Request processed in 668us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572385.356951:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:1.0:1787572385.361905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.362419:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244293504 00000100:00100000:0.0:1787572385.362430:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244293504 00000100:00100000:0.0:1787572385.362496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:0.0:1787572385.362507:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:9685:x1874405244293504:12345-192.168.204.55@tcp:36:rm.0 00010000:00010000:0.0:1787572385.362577:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787572385.362605:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f4364e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db95e expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362629:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436495 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db942 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362668:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d1c577c800) 00010000:00010000:0.0:1787572385.362687:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4364aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db949 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362713:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1c3a46600) 00010000:00010000:0.0:1787572385.362717:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572385.362737:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362751:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362760:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362777:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362785:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362806:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362927:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362936:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.362943:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787572385.365323:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787572385.365342:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315461705914ns, next at 316461702927ns, rc = 0 00010000:00010000:0.0:1787572385.365442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365457:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365467:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365476:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365482:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365488:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365579:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572385.365605:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365611:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365617:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365623:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.365627:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365678:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365699:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d1e1353e00) 00010000:00010000:0.0:1787572385.365702:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787572385.365708:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365714:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31200/0x9fe530ef4f4364fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365735:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365741:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365747:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365752:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.365755:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365761:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365767:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1c3a46600) 00010000:00010000:0.0:1787572385.365769:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.365773:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.365778:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31000/0x9fe530ef4f4364f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787572385.366387:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bedef767 reply state 00000000a8d25b6d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572385.366398:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787572385.366497:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:9685:x1874405244293504:12345-192.168.204.55@tcp:36:rm.0 Request processed in 3989us (4598us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787572385.366505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:2.0:1787572385.371976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572385.372747:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244293760 00000100:00100000:3.0:1787572385.372758:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244293760 00000100:00100000:3.0:1787572385.372817:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1787572385.372829:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:9685:x1874405244293760:12345-192.168.204.55@tcp:35:rm.0 00000100:00100000:3.0:1787572385.374397:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:9685:x1874405244293760:12345-192.168.204.55@tcp:35:rm.0 Request processed in 1563us (2422us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787572385.374409:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00010000:00010000:0.0:1787572385.374597:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.374609:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.374616:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.374623:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.374628:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.374659:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.374677:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff98d1e1353100) 00010000:00010000:0.0:1787572385.374681:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.374685:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.374691:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30c00/0x9fe530ef4f4364f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.376874:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572385.376888:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.376899:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572385.376904:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.376914:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.376931:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d1e1353e00) 00010000:00010000:1.0:1787572385.376934:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787572385.376938:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.376944:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436505 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.376964:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572385.376966:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572385.376968:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572385.378747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572385.378914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244294016 00000100:00100000:0.0:1787572385.378925:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244294016 00000100:00100000:0.0:1787572385.378993:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:0.0:1787572385.379004:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:9685:x1874405244294016:12345-192.168.204.55@tcp:36:rm.0 00010000:00010000:0.0:1787572385.379075:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787572385.379111:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4364c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db957 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379132:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db934 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379144:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1c3a46600) 00010000:00010000:0.0:1787572385.379172:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30a00/0x9fe530ef4f436425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db926 expref: 14 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379182:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1e1353000) 00010000:00010000:0.0:1787572385.379189:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572385.379214:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379227:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379237:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379248:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379266:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379273:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379609:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379619:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.379627:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572385.380321:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787572385.380338:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380346:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380353:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380359:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.380363:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380369:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380388:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d1e1353600) 00010000:00010000:0.0:1787572385.380390:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787572385.380395:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380401:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f43651a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380422:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380428:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380433:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380439:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.380442:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380448:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380455:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1e1353400) 00010000:00010000:0.0:1787572385.380457:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.380460:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.380465:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f43650c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787572385.380488:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e692c37 reply state 00000000dd29a03f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572385.380497:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787572385.380586:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:9685:x1874405244294016:12345-192.168.204.55@tcp:36:rm.0 Request processed in 1581us (1844us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787572385.380595:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00010000:00010000:0.0:1787572385.384995:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.385013:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.385021:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.385028:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572385.385032:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.385041:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.385235:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98d1e1353f00) 00010000:00010000:0.0:1787572385.385240:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572385.385246:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572385.385253:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436513 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572385.582883:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572386.607790:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572387.632385:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572388.658171:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572389.359975:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268445184:0@lo:400:kworker.0 00000100:00100000:2.0:1787572389.360063:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572389.360164:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268445184 00000100:00100000:1.0:1787572389.360174:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268445184 00000100:00100000:1.0:1787572389.360230:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787572389.360239:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268445184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.361936:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268445312:0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.362033:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572389.362087:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268445312 00000100:00100000:0.0:1787572389.362093:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268445312 00000100:00100000:0.0:1787572389.362138:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787572389.362147:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268445312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.362195:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268445312:12345-0@lo:400:kworker.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572389.362202:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787572389.362245:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268445312:0@lo:400:kworker.0 00000100:00100000:1.0:1787572389.364484:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268445184:12345-0@lo:400:kworker.0 Request processed in 4238us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572389.364498:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787572389.369572:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268445440:0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.369672:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572389.369731:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572389.369737:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268445568:0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.369766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572389.369814:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268445440 00000100:00100000:0.0:1787572389.369822:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268445440 00000100:00100000:0.0:1787572389.369890:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787572389.369901:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268445440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.369954:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268445440:12345-0@lo:400:kworker.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572389.369961:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787572389.370017:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268445440:0@lo:400:kworker.0 00000100:00100000:1.0:1787572389.370444:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268445568 00000100:00100000:1.0:1787572389.370448:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268445568 00000100:00100000:1.0:1787572389.370497:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787572389.370505:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572389.370552:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268445568:12345-0@lo:400:kworker.0 Request processed in 47us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572389.370559:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787572389.370579:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787572389.370584:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787572389.370603:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1eacd0380 x1874405268445568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572389.370616:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268445568:0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.371090:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268445824:0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.371124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572389.371154:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787572389.371161:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268445696:0@lo:400:kworker.0 00000100:00100000:0.0:1787572389.371185:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572389.372297:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268445824 00000100:00100000:1.0:1787572389.372307:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268445824 00000100:00100000:1.0:1787572389.372371:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787572389.372390:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268445824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572389.372443:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268445824:12345-0@lo:400:kworker.0 Request processed in 64us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572389.372459:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787572389.372717:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268445184:0@lo:400:kworker.0 00000100:00080000:0.0:1787572389.372739:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787572389.372763:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1eacd2300 x1874405268445824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572389.372776:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268445824:0@lo:400:kworker.0 00000100:00100000:3.0:1787572389.378896:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268445696 00000100:00100000:3.0:1787572389.378913:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268445696 00000100:00080000:0.0:1787572389.379280:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572389.379626:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787572389.379672:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268445696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572389.379780:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268445696:12345-0@lo:400:kworker.0 Request processed in 144us (8592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572389.379787:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787572389.379942:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268445696:0@lo:400:kworker.0 00010000:00010000:1.0:1787572389.681992:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787572389.870807:0:8059:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319967169214ns, next at 320967166453ns, rc = 0 00000100:00100000:1.0:1787572389.870827:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268445952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572389.870901:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572389.871088:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268445952 00000100:00100000:2.0:1787572389.871096:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268445952 00000100:00100000:2.0:1787572389.871148:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787572389.871158:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268445952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572389.871194:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572389.871257:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268445952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572389.871265:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787572389.871305:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43cc380 x1874405268445952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572389.871325:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268445952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572390.209367:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572390.209464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572390.210750:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244294400 00000100:00100000:3.0:1787572390.210762:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244294400 00000100:00100000:3.0:1787572390.210831:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:3.0:1787572390.210852:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244294400:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572390.210922:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244294400:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 83us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572390.210930:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00080000:3.0:1787572390.210952:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572390.211246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572390.211358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572390.211383:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244294272 00000100:00100000:0.0:1787572390.211388:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244294272 00000100:00100000:0.0:1787572390.211422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244294528 00000100:00100000:0.0:1787572390.211426:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244294528 00000100:00100000:0.0:1787572390.211447:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:0.0:1787572390.211455:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:2354:x1874405244294272:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572390.211501:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:2354:x1874405244294272:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 48us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572390.211508:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:0.0:1787572390.211520:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:0.0:1787572390.211526:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244294528:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572390.211551:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244294528:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572390.211567:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00080000:0.0:1787572390.211590:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572390.214118:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244294144 00000100:00100000:1.0:1787572390.214134:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244294144 00000100:00100000:0.0:1787572390.226776:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 250 00000100:00100000:0.0:1787572390.226792:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244294144:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572390.226880:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244294144:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 92us (17523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572390.226888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 250 00000100:00100000:0.0:1787572390.394798:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572390.394823:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268446080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572390.394895:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572390.398938:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268446080 00000100:00100000:0.0:1787572390.398953:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268446080 00000100:00100000:0.0:1787572390.402304:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787572390.402519:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268446080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572390.402562:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572390.404417:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268446080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2095us (9516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572390.404429:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787572390.404490:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43cd880 x1874405268446080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572390.404514:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268446080:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787572390.437403:0:11625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1787572390.492371:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1787572390.492387:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1787572390.492960:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1787572390.493117:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572390.493136:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268446208:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787572390.493465:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572390.495344:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268446208 00000100:00100000:2.0:1787572390.495357:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268446208 00000100:00100000:2.0:1787572390.495423:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787572390.495435:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268446208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787572390.495466:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787572390.495505:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c309f, atime: 0x6a8c309f, ctime: 0x6a8c309f, blocks: 0x1 00010000:00010000:2.0:1787572390.495513:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.495535:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:2.0:1787572390.495540:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572390.495546:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.495562:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.495572:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.495579:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.495596:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787572390.496201:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874405268446208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 768us (2995us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787572390.496279:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787572390.496304:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572390.496311:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.496320:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572390.496324:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.496346:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.496363:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.496370:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436521 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572390.496388:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572390.496389:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572390.496391:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787572390.497917:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1fc4a3b80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787572390.497928:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268446208:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787572390.705486:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572391.734467:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787572391.905973:0:11674:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcadb14f20 20000000:00000080:3.0:1787572391.906003:0:11674:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d0c5261800 uarg=0000000000000000 20000000:01000000:3.0:1787572391.906061:0:11674:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787572391.906070:0:11674:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787572391.906076:0:11674:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787572391.918490:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787572391.920211:0:11674:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787572391.958432:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787572391.958497:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787572391.958565:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787572391.958585:0:11674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787572391.958606:0:11674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958627:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958662:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958673:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958697:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958704:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958713:0:11674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958769:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958801:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 18 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572391.958818:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446336:0@lo:104: 00000100:00100000:1.0:1787572391.958884:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787572391.958965:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.958975:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 18 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572391.958986:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268446336 00000100:00100000:1.0:1787572391.958986:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446464:0@lo:104: 00000100:00100000:3.0:1787572391.959005:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268446336 00000100:00100000:1.0:1787572391.959015:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787572391.959052:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959061:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 18 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572391.959081:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446592:0@lo:104: 00000100:00100000:3.0:1787572391.959104:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268446464 00000100:00100000:3.0:1787572391.959110:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268446464 00000100:00100000:1.0:1787572391.959119:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787572391.959166:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572391.959168:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787572391.959189:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 12 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572391.959194:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268446592 00000100:00100000:3.0:1787572391.959203:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268446592 00000100:00100000:1.0:1787572391.959209:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446720:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572391.959243:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787572391.959260:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+5:11674:x1874405268446336:12345-0@lo:104: 00010000:00010000:3.0:1787572391.959283:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572391.959399:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787572391.959411:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+5:11674:x1874405268446336:12345-0@lo:104: Request processed in 156us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572391.959421:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787572391.959437:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572391.959449:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787572391.959451:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 12 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572391.959465:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+4:11674:x1874405268446464:12345-0@lo:104: 00000100:00100000:1.0:1787572391.959471:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e49180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446848:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572391.959481:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572391.959529:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2e63240 going to sleep for 11 seconds 00010000:00010000:3.0:1787572391.959541:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787572391.959566:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446336:0@lo:104: 00000100:00100000:3.0:1787572391.959568:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+4:11674:x1874405268446464:12345-0@lo:104: Request processed in 90us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572391.959581:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446464:0@lo:104: 00000100:00100000:3.0:1787572391.959607:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787572391.959628:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787572391.959682:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1787572391.959686:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c52e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:11674:x1874405268446592:12345-0@lo:104: 00010000:00010000:1.0:1787572391.959693:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572391.959698:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959714:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572391.959719:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959759:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572391.959770:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572391.959777:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787572391.959779:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787572391.959788:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c52e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+3:11674:x1874405268446592:12345-0@lo:104: Request processed in 152us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572391.959795:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787572391.959819:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959828:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787572391.959855:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787572391.959859:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959867:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4363ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959881:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572391.959884:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959890:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572391.959893:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959900:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572391.959906:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572391.959918:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787572391.959935:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959942:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572391.959974:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959981:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31600/0x9fe530ef4f4363d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363d8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.959991:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572391.959993:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572391.959995:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572391.960019:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268446976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572391.960056:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572391.960102:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268447104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572391.960125:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572391.960157:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268446976 00000100:00100000:1.0:1787572391.960163:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268446976 00010000:00010000:1.0:1787572391.960190:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 19 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572391.960216:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268447104 00000100:00100000:1.0:1787572391.960219:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268447104 00010000:00010000:1.0:1787572391.960230:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 20 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572391.960248:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787572391.960266:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+20:3311:x1874405268446976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572391.960281:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572391.960287:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 20 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.960299:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 20 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.960313:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a31400/0x9fe530ef4f4363f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4363ed expref: 20 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.960325:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572391.960357:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268446976:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572391.960364:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787572391.960379:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787572391.960385:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+18:3312:x1874405268447104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572391.960392:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572391.960396:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 18 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.960404:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 18 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.960413:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572391.960434:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+18:3312:x1874405268447104:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572391.960439:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787572391.960465:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268446976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572391.960497:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268447104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572391.960522:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8c00/0x9fe530ef4f4363d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4363d1 expref: 17 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572391.960532:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446592:0@lo:104: 00010000:00010000:3.0:1787572391.963110:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572391.963127:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9400 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:3.0:1787572391.963131:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572391.963143:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787572391.963152:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572391.963158:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787572391.967574:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.967596:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572391.967649:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.967657:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c13c9400/0x9fe530ef4f4363df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4363e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.967683:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572391.967685:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572391.967687:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572391.972107:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572391.972141:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268447232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787572391.972319:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572391.972462:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268447232 00000100:00100000:1.0:1787572391.972471:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268447232 00010000:00010000:1.0:1787572391.972506:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 17 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572391.972547:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787572391.972557:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+17:3312:x1874405268447232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572391.972572:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572391.972578:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 17 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.972602:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 17 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.972621:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc277e00/0x9fe530ef4f4363e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4363df expref: 17 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.972658:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572391.972700:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3312:x1874405268447232:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572391.972708:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787572391.973506:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268447232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787572391.980129:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446720:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572391.980883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572391.983067:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244294656 00000100:00100000:3.0:1787572391.983131:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244294656 00010000:00010000:3.0:1787572391.983210:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 13 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572391.983303:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1787572391.983317:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244294656:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572391.983336:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572391.983342:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 13 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572391.983356:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 13 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572391.983378:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a31e00/0x9fe530ef4f4363ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db918 expref: 13 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572391.983400:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572391.983489:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46025283-1dc6-4449-aad9-047e59682663+12:2353:x1874405244294656:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 175us (3866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572391.983498:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:1.0:1787572391.994596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572391.994673:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244294784 00000100:00100000:1.0:1787572391.994684:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244294784 00010000:00010000:1.0:1787572391.994728:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 12 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572391.995034:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:1.0:1787572391.995046:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+12:2354:x1874405244294784:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572391.995063:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572391.995070:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 12 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995083:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 12 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995127:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995135:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995153:0:7642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995160:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995167:0:7642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995173:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995180:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572391.995185:0:7642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995193:0:7642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995215:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572391.995233:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572391.995284:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+12:2354:x1874405244294784:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 240us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572391.995311:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00010000:00010000:2.0:1787572391.995426:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c9a00/0x9fe530ef4f4363c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db911 expref: 11 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572391.995442:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e49180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874405268446848:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572391.995478:0:11674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572391.995487:0:11674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572391.995493:0:11674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572391.995510:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c0030200/0x9fe530ef4f436528 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572392.752284:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572393.407818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572393.408679:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244294912 00000100:00100000:2.0:1787572393.408692:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244294912 00000100:00100000:2.0:1787572393.408779:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 251 00000100:00100000:2.0:1787572393.408790:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+11:5597:x1874405244294912:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572393.408810:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572393.408830:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43652f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db965 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.408864:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43652f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db965 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.408875:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43652f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db965 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.408899:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276c00, rc 0) 00000100:00100000:2.0:1787572393.408981:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244294912:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 191us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.408988:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 251 00000100:00100000:2.0:1787572393.433401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572393.439479:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244295040 00000100:00100000:0.0:1787572393.439497:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244295040 00000100:00100000:0.0:1787572393.439572:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 252 00000100:00100000:0.0:1787572393.439585:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244295040:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.439938:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244295040:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 344us (6537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.439947:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 252 00000100:00100000:1.0:1787572393.451522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572393.451680:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244295168 00000100:00100000:0.0:1787572393.451694:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244295168 00000100:00100000:0.0:1787572393.451817:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 253 00000100:00100000:0.0:1787572393.451829:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244295168:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.452084:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244295168:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 256us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.452092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 253 00000100:00100000:1.0:1787572393.459050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572393.459225:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244295296 00000100:00100000:2.0:1787572393.459237:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244295296 00000100:00100000:2.0:1787572393.459304:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 254 00000100:00100000:2.0:1787572393.459316:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+12:9956:x1874405244295296:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787572393.462773:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+12:9956:x1874405244295296:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 3450us (3724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.462787:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 254 00000100:00100000:1.0:1787572393.473623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572393.473778:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244295424 00000100:00100000:0.0:1787572393.473792:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244295424 00000100:00100000:0.0:1787572393.473857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 255 00000100:00100000:0.0:1787572393.473869:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+12:9956:x1874405244295424:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787572393.474507:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+12:9956:x1874405244295424:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 636us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.474517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 255 00000100:00100000:1.0:1787572393.498677:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572393.498791:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244295552 00000100:00100000:2.0:1787572393.498803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244295552 00000100:00100000:2.0:1787572393.498909:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 256 00000100:00100000:2.0:1787572393.498920:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+12:5597:x1874405244295552:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572393.498949:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572393.498970:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc277000/0x9fe530ef4f436536 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151db96c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.499000:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc277000/0x9fe530ef4f436536 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db96c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.499011:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc277000/0x9fe530ef4f436536 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db96c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.499022:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277000, rc 0) 00000100:00100000:2.0:1787572393.499082:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244295552:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 165us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.499089:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 256 00000100:00100000:1.0:1787572393.503761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572393.504074:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244295680 00000100:00100000:0.0:1787572393.504086:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244295680 00000100:00100000:0.0:1787572393.504151:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 257 00000100:00100000:0.0:1787572393.504162:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244295680:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.504500:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244295680:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 339us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.504509:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 257 00000100:00100000:1.0:1787572393.508685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572393.508833:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244295808 00000100:00100000:2.0:1787572393.508845:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244295808 00000100:00100000:2.0:1787572393.508916:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 258 00000100:00100000:2.0:1787572393.508945:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244295808:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572393.509307:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:5597:x1874405244295808:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 363us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.509320:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 258 10000000:01000000:0.0:1787572393.518751:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787572393.518761:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1d0ba8000 from 7 10000000:01000000:0.0:1787572393.518767:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787572393.518821:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572393.518832:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572393.518843:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572393.518871:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268447360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.518967:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572393.519028:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d9e12c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572393.519289:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268447360 00000100:00100000:2.0:1787572393.519298:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268447360 00000100:00100000:2.0:1787572393.519357:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787572393.519366:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:5839:x1874405268447360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572393.519496:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572393.519511:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f436544 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43653d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.519535:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f436544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43653d expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.519545:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f436544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43653d expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.519554:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276200, rc 0) 00000100:00100000:2.0:1787572393.519609:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268447360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.519615:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787572393.520034:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268447360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572393.520050:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572393.520060:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572393.520115:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268447488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.520141:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572393.520197:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d9e12c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572393.520467:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268447488 00000100:00100000:2.0:1787572393.520472:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268447488 00000100:00100000:2.0:1787572393.520549:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787572393.520559:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268447488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572393.520834:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268447488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.520840:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787572393.520906:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268447488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.520952:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268447616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.520991:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572393.521652:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572393.526413:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d9e12c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572393.526444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268447616 00000100:00100000:0.0:1787572393.526453:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268447616 00000100:00100000:0.0:1787572393.526497:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244295936 00000100:00100000:0.0:1787572393.526501:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244295936 00000100:00100000:0.0:1787572393.526519:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787572393.526529:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268447616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.526818:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268447616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (5826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.526827:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787572393.526865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 262 00000100:00100000:0.0:1787572393.526871:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:9959:x1874405244295936:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787572393.528551:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:9959:x1874405244295936:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 1671us (6891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.528563:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 262 00000100:00100000:1.0:1787572393.533268:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268447616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.535215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572393.535247:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244296064 00000100:00100000:0.0:1787572393.535254:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244296064 00000100:00100000:0.0:1787572393.535291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 263 00000100:00100000:0.0:1787572393.535300:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:9959:x1874405244296064:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787572393.535540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:9959:x1874405244296064:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 240us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.535554:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 263 00000100:00100000:1.0:1787572393.538741:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11688:1874405268447744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572393.538834:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572393.538878:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2e639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572393.539126:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268447744 00000100:00100000:2.0:1787572393.539142:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268447744 00000100:00100000:2.0:1787572393.539202:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787572393.539213:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:11688:x1874405268447744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572393.539456:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:11688:x1874405268447744:12345-0@lo:502:llog_process_th.0 Request processed in 244us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.539465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787572393.540054:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11688:1874405268447744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787572393.540092:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572393.540102:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572393.540104:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787572393.540111:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d1d0ba8000 00000020:00000080:1.0:1787572393.540114:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787572393.540212:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11688:1874405268447872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572393.540251:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572393.540283:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2e639c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572393.542503:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268447872 00000100:00100000:3.0:1787572393.542514:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268447872 00000100:00100000:3.0:1787572393.542591:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787572393.542603:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:11688:x1874405268447872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572393.542901:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:11688:x1874405268447872:12345-0@lo:502:llog_process_th.0 Request processed in 301us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572393.542909:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787572393.545823:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11688:1874405268447872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787572393.545878:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572393.545899:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572393.545902:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787572393.545907:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787572393.546119:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787572393.546140:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787572393.546151:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.546163:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572393.546174:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787572393.546176:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1cebea800 from 7 10000000:01000000:2.0:1787572393.546179:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787572393.546212:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.546219:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.546241:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572393.546260:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572393.546316:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572393.546357:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572393.546809:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268448000 00000100:00100000:3.0:1787572393.546818:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268448000 00000100:00100000:3.0:1787572393.546885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787572393.546910:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+17:5839:x1874405268448000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572393.549572:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572393.549682:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc277800/0x9fe530ef4f436552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43654b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.549734:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc277800/0x9fe530ef4f436552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43654b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.549747:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc277800/0x9fe530ef4f436552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43654b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.549756:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277800, rc 0) 00000100:00100000:2.0:1787572393.549837:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268448000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2930us (3519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.549846:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787572393.550064:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572393.550084:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572393.550095:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572393.550173:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.550213:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572393.550261:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d9e12600 going to sleep for 11 seconds 00000100:00100000:2.0:1787572393.550413:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268448128 00000100:00100000:2.0:1787572393.550420:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268448128 00000100:00100000:2.0:1787572393.550464:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787572393.550474:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268448128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572393.550795:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268448128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.550803:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787572393.550898:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572393.550947:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572393.550990:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572393.551023:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572393.551113:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268448256 00000100:00100000:0.0:1787572393.551118:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268448256 00000100:00100000:0.0:1787572393.551146:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787572393.551155:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268448256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.551323:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268448256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.551330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787572393.551412:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572393.552226:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11690:1874405268448384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572393.552277:0:11690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572393.552351:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572393.552391:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268448384 00000100:00100000:0.0:1787572393.552398:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268448384 00000100:00100000:0.0:1787572393.552465:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787572393.552475:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ee3d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:11690:x1874405268448384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572393.552675:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ee3d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:11690:x1874405268448384:12345-0@lo:502:llog_process_th.0 Request processed in 201us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572393.552684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787572393.552813:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11690:1874405268448384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787572393.552838:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572393.552847:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572393.552850:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787572393.552856:0:11690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d1cebea800 00000020:00000080:3.0:1787572393.552859:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787572393.552951:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11690:1874405268448512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572393.552984:0:11690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572393.553118:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572393.553184:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268448512 00000100:00100000:2.0:1787572393.553189:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268448512 00000100:00100000:2.0:1787572393.553211:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787572393.553219:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:11690:x1874405268448512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572393.553371:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:11690:x1874405268448512:12345-0@lo:502:llog_process_th.0 Request processed in 152us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.553389:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787572393.553944:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11690:1874405268448512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787572393.553973:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572393.553980:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572393.553981:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787572393.553986:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787572393.554175:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787572393.554195:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787572393.554205:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.554217:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572393.554228:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787572393.554230:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1c4a88000 from 7 10000000:01000000:2.0:1787572393.554233:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787572393.554260:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.554269:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.554279:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572393.554296:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572393.554336:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572393.554404:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572393.554444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268448640 00000100:00100000:3.0:1787572393.554450:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268448640 00000100:00100000:3.0:1787572393.554488:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787572393.554499:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+18:5839:x1874405268448640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572393.554518:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572393.554532:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1de0eb400/0x9fe530ef4f436560 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f436559 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572393.554555:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0eb400/0x9fe530ef4f436560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f436559 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572393.554564:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1de0eb400/0x9fe530ef4f436560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f436559 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572393.554574:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb400, rc 0) 00000100:00100000:3.0:1787572393.554701:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268448640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572393.554709:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787572393.554815:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787572393.554827:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.554953:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572393.555013:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787572393.555041:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572393.555108:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d2fa9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572393.555151:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268448768 00000100:00100000:3.0:1787572393.555155:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268448768 00000100:00100000:3.0:1787572393.555232:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787572393.555244:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268448768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572393.555561:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268448768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572393.555569:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787572393.555678:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.555715:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.555757:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572393.555829:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d9e129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572393.555889:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268448896 00000100:00100000:3.0:1787572393.555894:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268448896 00000100:00100000:3.0:1787572393.555919:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787572393.556089:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268448896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572393.556284:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:5839:x1874405268448896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572393.556302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787572393.556391:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d30d720-8336-413c-aa2f-3c1df9a74652:5839:1874405268448896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572393.556862:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11692:1874405268449024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572393.557072:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572393.557132:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d9e12600 going to sleep for 11 seconds 00000100:00100000:2.0:1787572393.557165:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268449024 00000100:00100000:2.0:1787572393.557170:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268449024 00000100:00100000:2.0:1787572393.557236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787572393.557246:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:11692:x1874405268449024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572393.557406:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:11692:x1874405268449024:12345-0@lo:502:llog_process_th.0 Request processed in 162us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572393.557413:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787572393.557481:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11692:1874405268449024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572393.557509:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572393.557519:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572393.557521:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787572393.557528:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d1c4a88000 00000020:00000080:0.0:1787572393.557531:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787572393.557879:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11692:1874405268449152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572393.557941:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572393.558150:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c72b5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787572393.558182:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268449152 00000100:00100000:3.0:1787572393.558187:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268449152 00000100:00100000:3.0:1787572393.558228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787572393.558238:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:11692:x1874405268449152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572393.558453:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:11692:x1874405268449152:12345-0@lo:502:llog_process_th.0 Request processed in 217us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572393.558460:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787572393.558574:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d30d720-8336-413c-aa2f-3c1df9a74652:11692:1874405268449152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787572393.558597:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572393.558605:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572393.558606:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787572393.558611:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787572393.559090:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787572393.559110:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787572393.559120:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572393.559131:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787572393.564749:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787572393.775298:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572394.479273:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268449536:0@lo:400:kworker.0 00000100:00100000:1.0:1787572394.479350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572394.479425:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572394.479431:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268449664:0@lo:400:kworker.0 00000100:00100000:1.0:1787572394.479459:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572394.479500:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268449664 00000100:00100000:1.0:1787572394.479507:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268449664 00000100:00100000:1.0:1787572394.479561:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787572394.479571:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268449664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572394.479623:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268449664:12345-0@lo:400:kworker.0 Request processed in 54us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572394.479630:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787572394.479684:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268449536 00000100:00100000:1.0:1787572394.479688:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268449536 00000100:00100000:1.0:1787572394.479718:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787572394.479724:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268449536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572394.479757:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268449536:12345-0@lo:400:kworker.0 Request processed in 33us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572394.479762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1787572394.479797:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1d0b74a80 x1874405268449664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572394.479810:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268449664:0@lo:400:kworker.0 00000100:00100000:1.0:1787572394.479833:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268449536:0@lo:400:kworker.0 00000100:00080000:1.0:1787572394.479869:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787572394.479874:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572394.480151:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268449408:0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480184:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572394.480214:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268449920:0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480235:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572394.480274:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787572394.480280:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268449280:0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480309:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572394.480338:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268449792:0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480375:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572394.480403:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268449920 00000100:00100000:2.0:1787572394.480407:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268449920 00000100:00100000:2.0:1787572394.480440:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787572394.480446:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874405268449920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480484:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874405268449920:12345-0@lo:400:kworker.0 Request processed in 38us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572394.480490:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787572394.480510:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268449408 00000100:00100000:2.0:1787572394.480514:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268449408 00000100:00100000:2.0:1787572394.480534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268449792 00000100:00100000:2.0:1787572394.480537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268449792 00000100:00100000:2.0:1787572394.480556:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787572394.480562:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268449408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480594:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268449408:12345-0@lo:400:kworker.0 Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572394.480600:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787572394.480610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787572394.480616:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268449792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480666:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268449792:12345-0@lo:400:kworker.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572394.480684:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1787572394.480700:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787572394.480703:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787572394.480727:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268449792:0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480736:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268449408:0@lo:400:kworker.0 00000100:00100000:2.0:1787572394.480754:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268449920:0@lo:400:kworker.0 00000100:00100000:3.0:1787572394.481295:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268449280 00000100:00100000:3.0:1787572394.481301:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268449280 00000100:00100000:3.0:1787572394.481343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787572394.481364:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268449280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572394.481415:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268449280:12345-0@lo:400:kworker.0 Request processed in 66us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572394.481421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787572394.481586:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268449280:0@lo:400:kworker.0 00000040:00080000:1.0:1787572394.608048:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787572394.800622:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572394.991229:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268450048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572394.991309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572394.991476:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268450048 00000100:00100000:2.0:1787572394.991485:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268450048 00000100:00100000:2.0:1787572394.991544:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787572394.991554:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268450048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572394.991618:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572394.991694:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268450048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572394.991702:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787572394.992091:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268450048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572395.330555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572395.330778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572395.330836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572395.330861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572395.330956:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244296448 00000100:00100000:3.0:1787572395.330968:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244296448 00000100:00100000:3.0:1787572395.331055:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:3.0:1787572395.331079:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244296448:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572395.331158:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244296448:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 93us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572395.331166:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:2.0:1787572395.331533:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244296192 00000100:00100000:2.0:1787572395.331538:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244296192 00000100:00100000:2.0:1787572395.331579:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 277 00000100:00100000:2.0:1787572395.331587:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244296192:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572395.331771:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244296192:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 185us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572395.331785:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 277 00000100:00100000:2.0:1787572395.331824:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244296320 00000100:00100000:2.0:1787572395.331828:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244296320 00000100:00100000:2.0:1787572395.331858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244296576 00000100:00100000:2.0:1787572395.331861:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244296576 00000100:00100000:2.0:1787572395.331884:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:2.0:1787572395.331903:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244296320:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572395.331934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244296320:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 44us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572395.331941:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:2.0:1787572395.331953:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:2.0:1787572395.331972:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244296576:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572395.331997:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244296576:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 26us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572395.332004:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00080000:1.0:1787572395.333614:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787572395.333625:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787572395.504377:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268450176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572395.504475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572395.504569:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268450176 00000100:00100000:2.0:1787572395.504577:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268450176 00000100:00100000:2.0:1787572395.504623:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787572395.505010:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268450176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572395.505053:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572395.505101:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268450176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 469us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572395.505109:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787572395.505164:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f43cca80 x1874405268450176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572395.505253:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268450176:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787572395.623426:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1787572395.823420:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572396.847544:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572397.871064:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572398.895688:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572399.598966:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268450688:0@lo:400:kworker.0 00000100:00100000:0.0:1787572399.599043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572399.599112:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787572399.599118:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268450560:0@lo:400:kworker.0 00000100:00100000:0.0:1787572399.599144:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572399.599178:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268450560 00000100:00100000:0.0:1787572399.599186:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268450560 00000100:00100000:0.0:1787572399.599246:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787572399.599258:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268450560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572399.599326:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268450560:12345-0@lo:400:kworker.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572399.599333:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787572399.599590:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268450304:0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.599626:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572399.599679:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268450816:0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.599715:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572399.599732:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787572399.599737:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268450432:0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.599760:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572399.599781:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268450944:0@lo:400:kworker.0 00000100:00100000:2.0:1787572399.599784:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268450688 00000100:00100000:2.0:1787572399.599790:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268450688 00000100:00100000:3.0:1787572399.599805:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572399.599842:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268450944 00000100:00100000:2.0:1787572399.599846:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268450944 00000100:00100000:2.0:1787572399.599864:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787572399.599872:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268450688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572399.599916:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268450688:12345-0@lo:400:kworker.0 Request processed in 45us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572399.599931:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268450304 00000100:00100000:2.0:1787572399.599932:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787572399.599937:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268450304 00000100:00100000:2.0:1787572399.599950:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787572399.599958:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268450944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.599973:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787572399.599982:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268450304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572399.599999:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268450944:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572399.600005:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787572399.600039:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787572399.600044:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d1fc4a3b80, transno 4294967300 00000100:00100000:2.0:1787572399.600056:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268450944:0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.600100:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268450304:12345-0@lo:400:kworker.0 Request processed in 119us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572399.600108:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268450304:0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.600109:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787572399.600148:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268450816 00000100:00100000:2.0:1787572399.600151:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268450816 00000100:00100000:2.0:1787572399.600179:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268450432 00000100:00100000:2.0:1787572399.600183:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268450432 00000100:00080000:1.0:1787572399.600239:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787572399.600244:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787572399.600246:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572399.600606:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268450560:0@lo:400:kworker.0 00010000:00080000:1.0:1787572399.600621:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1d09ce300 x1874405268450688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572399.600632:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268450688:0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.613207:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787572399.613228:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268450816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.613348:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268450816:12345-0@lo:400:kworker.0 Request processed in 128us (13631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572399.613355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787572399.613378:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787572399.613385:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268450432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572399.613899:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268450816:0@lo:400:kworker.0 00000100:00100000:3.0:1787572399.614267:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268450432:12345-0@lo:400:kworker.0 Request processed in 881us (14506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572399.614275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787572399.614751:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268450432:0@lo:400:kworker.0 00010000:00010000:1.0:1787572399.919851:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572400.111351:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268451072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572400.111445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572400.111590:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268451072 00000100:00100000:2.0:1787572400.111604:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268451072 00000100:00100000:2.0:1787572400.111687:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787572400.111699:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268451072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572400.111739:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572400.111813:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268451072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572400.111820:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787572400.112962:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268451072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572400.449836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572400.449880:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572400.449917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572400.449959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572400.450042:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244296960 00000100:00100000:2.0:1787572400.450054:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244296960 00000100:00100000:2.0:1787572400.450142:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:2.0:1787572400.450153:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244296960:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572400.450237:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244296960:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 85us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572400.450245:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:2.0:1787572400.450267:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244296832 00000100:00100000:2.0:1787572400.450271:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244296832 00000100:00100000:2.0:1787572400.450294:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244297088 00000100:00100000:2.0:1787572400.450297:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244297088 00000100:00100000:2.0:1787572400.450315:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00080000:0.0:1787572400.450449:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787572400.450454:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572400.450580:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 119 00000100:00100000:0.0:1787572400.450589:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244297088:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572400.450628:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244297088:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 41us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572400.450666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 119 00000100:00100000:2.0:1787572400.451183:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244296832:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572400.451225:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244296832:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 903us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572400.451232:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:3.0:1787572400.451552:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244296704 00000100:00100000:3.0:1787572400.451567:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244296704 00000100:00100000:3.0:1787572400.451662:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 279 00000100:00100000:3.0:1787572400.451682:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244296704:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572400.451711:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244296704:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 32us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572400.451718:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 279 00000100:00100000:0.0:1787572400.623394:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268451200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572400.623487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572400.623662:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268451200 00000100:00100000:2.0:1787572400.623670:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268451200 00000100:00100000:2.0:1787572400.623725:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787572400.623735:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268451200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572400.623773:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572400.623838:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268451200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572400.623846:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787572400.623926:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40c5c00 x1874405268451200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572400.623947:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268451200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787572400.943667:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572401.967599:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572402.998434:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572404.014867:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572404.720629:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268451328:0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.720742:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572404.720812:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268451840:0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.720840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572404.720868:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787572404.720889:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268451456:0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.720911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572404.720928:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268451968:0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.720950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572404.720981:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268451840 00000100:00100000:2.0:1787572404.720988:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268451840 00000100:00100000:2.0:1787572404.721052:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268451456 00000100:00100000:2.0:1787572404.721056:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268451456 00000100:00100000:2.0:1787572404.721075:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787572404.721085:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268451840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.721151:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268451840:12345-0@lo:400:kworker.0 Request processed in 66us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572404.721158:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787572404.721176:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787572404.721182:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268451456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.721210:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268451456:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572404.721216:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1787572404.721236:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572404.721273:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268451456:0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.721284:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268451840:0@lo:400:kworker.0 00000100:00100000:3.0:1787572404.721489:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268451584:0@lo:400:kworker.0 00000100:00100000:3.0:1787572404.721521:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572404.721548:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572404.721554:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268451712:0@lo:400:kworker.0 00000100:00100000:3.0:1787572404.721576:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572404.721601:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268451968 00000100:00100000:3.0:1787572404.721605:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268451968 00000100:00100000:3.0:1787572404.721660:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268451712 00000100:00100000:3.0:1787572404.721664:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268451712 00000100:00100000:3.0:1787572404.721681:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787572404.721687:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268451968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572404.721734:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268451968:12345-0@lo:400:kworker.0 Request processed in 47us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572404.721740:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787572404.721754:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787572404.721760:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268451712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572404.721794:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268451712:12345-0@lo:400:kworker.0 Request processed in 34us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572404.721800:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1787572404.721827:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1d0b77b80 x1874405268451712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572404.721837:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268451712:0@lo:400:kworker.0 00000100:00100000:1.0:1787572404.722266:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268451328 00000100:00100000:1.0:1787572404.722272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268451328 00000100:00100000:1.0:1787572404.722315:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787572404.722324:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268451328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572404.722363:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268451328:12345-0@lo:400:kworker.0 Request processed in 41us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572404.722369:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:2.0:1787572404.722616:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572404.722621:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787572404.722631:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268451584 00000100:00100000:2.0:1787572404.722669:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268451584 00000100:00100000:2.0:1787572404.722725:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787572404.722733:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268451584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.722806:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268451584:12345-0@lo:400:kworker.0 Request processed in 74us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572404.722813:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787572404.722850:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268451968:0@lo:400:kworker.0 00000100:00100000:2.0:1787572404.722860:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268451328:0@lo:400:kworker.0 00000100:00100000:1.0:1787572404.722987:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268451584:0@lo:400:kworker.0 00000100:00080000:0.0:1787572404.723292:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787572404.847993:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787572405.039030:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572405.231748:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787572405.234826:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268452096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572405.234908:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572405.235287:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268452096 00000100:00100000:2.0:1787572405.235297:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268452096 00000100:00100000:2.0:1787572405.235439:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787572405.235450:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268452096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572405.235485:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572405.235546:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268452096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572405.235552:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787572405.235624:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268452096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572405.566586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572405.566665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572405.566886:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244297216 00000100:00100000:2.0:1787572405.566909:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244297216 00000100:00100000:2.0:1787572405.566967:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 281 00000100:00100000:2.0:1787572405.566978:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244297216:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572405.567057:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244297216:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 81us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572405.567065:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 281 00000100:00100000:3.0:1787572405.568142:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244297344 00000100:00100000:3.0:1787572405.568152:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244297344 00000100:00100000:3.0:1787572405.568236:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:3.0:1787572405.568247:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244297344:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572405.568316:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244297344:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 71us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572405.568323:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00080000:2.0:1787572405.569013:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572405.584334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572405.584669:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244297472 00000100:00100000:3.0:1787572405.584680:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244297472 00000100:00100000:3.0:1787572405.584835:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:3.0:1787572405.584847:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2352:x1874405244297472:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:3.0:1787572405.584882:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43649c 00000100:00080000:3.0:1787572405.584892:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d1f4170800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787572405.584941:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787572405.585305:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+2:2352:x1874405244297472:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 459us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572405.585314:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00010000:00010000:1.0:1787572405.586473:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787572405.586873:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572405.587381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572405.587558:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244297600 00000100:00100000:2.0:1787572405.587566:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244297600 00000100:00100000:2.0:1787572405.587727:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00100000:2.0:1787572405.587744:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244297600:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572405.587897:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244297600:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 155us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572405.587914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00080000:0.0:1787572405.590576:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572405.743991:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572405.744015:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268452224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572405.744087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572405.745710:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268452224 00000100:00100000:3.0:1787572405.745725:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268452224 00000100:00100000:3.0:1787572405.745779:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787572405.745789:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268452224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787572405.745833:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572405.745951:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268452224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572405.745958:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787572405.747450:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40c5500 x1874405268452224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572405.747484:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268452224:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787572405.831896:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:3.0:1787572405.831920:0:7653:0:(genops.c:885:class_export_put()) final put ffff98d1f4171800/6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:2.0:1787572405.832235:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1f4171800/6d499b5b-e864-4e70-bf3c-7c3a42e124cd for lustre-OST0001 00000020:00000080:2.0:1787572405.832295:0:473:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1f4170800 for lustre-OST0001 00010000:00010000:1.0:1787572406.062949:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572407.087631:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572408.111482:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572409.134964:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572409.838916:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268452352:0@lo:400:kworker.0 00000100:00100000:1.0:1787572409.838921:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268452608:0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.838998:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268452480:0@lo:400:kworker.0 00000100:00100000:2.0:1787572409.841741:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268452736:0@lo:400:kworker.0 00000100:00100000:0.0:1787572409.844713:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572409.844726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572409.844801:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268452992:0@lo:400:kworker.0 00000100:00100000:0.0:1787572409.844801:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268452864:0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.844853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572409.844858:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572409.844916:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268452352 00000100:00100000:0.0:1787572409.844924:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268452352 00000100:00100000:0.0:1787572409.844969:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787572409.844980:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268452352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.844982:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268452480 00000100:00100000:3.0:1787572409.844987:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268452480 00000100:00100000:3.0:1787572409.845018:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268452864 00000100:00100000:3.0:1787572409.845023:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268452864 00000100:00100000:0.0:1787572409.845054:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268452352:12345-0@lo:400:kworker.0 Request processed in 75us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572409.845058:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787572409.845066:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268452480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.845102:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268452480:12345-0@lo:400:kworker.0 Request processed in 38us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572409.845109:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787572409.845127:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787572409.845132:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268452864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.845156:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268452864:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572409.845161:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787572409.845200:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268452480:0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.845238:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268452992 00000100:00100000:3.0:1787572409.845242:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268452992 00000100:00100000:3.0:1787572409.845268:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787572409.845275:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268452992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.845492:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268452992:12345-0@lo:400:kworker.0 Request processed in 217us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572409.845508:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787572409.845538:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268452992:0@lo:400:kworker.0 00000100:00080000:3.0:1787572409.845565:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572409.845569:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572409.845593:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268452352:0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.845603:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268452864:0@lo:400:kworker.0 00000100:00100000:0.0:1787572409.846155:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787572409.848653:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572409.849370:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268452608 00000100:00100000:3.0:1787572409.849391:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268452608 00000100:00100000:3.0:1787572409.849465:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787572409.849476:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268452608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572409.849549:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268452608:12345-0@lo:400:kworker.0 Request processed in 74us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572409.849556:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1787572409.849695:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572409.849839:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268452608:0@lo:400:kworker.0 00000100:00100000:2.0:1787572409.853559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572409.853679:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268452736 00000100:00100000:0.0:1787572409.853691:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268452736 00000100:00100000:0.0:1787572409.853775:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787572409.853785:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268452736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572409.853862:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268452736:12345-0@lo:400:kworker.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572409.853869:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1787572409.853973:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40c7b80 x1874405268452736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572409.854010:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268452736:0@lo:400:kworker.0 00000100:00080000:3.0:1787572409.854727:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787572410.158857:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572410.354860:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572410.354887:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268453120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572410.354971:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572410.355300:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268453120 00000100:00100000:2.0:1787572410.355309:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268453120 00000100:00100000:2.0:1787572410.355369:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787572410.355379:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268453120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572410.355416:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572410.355477:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268453120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572410.355484:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787572410.355569:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268453120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572410.687463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572410.687517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572410.687565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572410.688166:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244297984 00000100:00100000:2.0:1787572410.688176:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244297984 00000100:00100000:2.0:1787572410.688246:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244297856 00000100:00100000:2.0:1787572410.688250:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244297856 00000100:00100000:2.0:1787572410.688275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 128 00000100:00100000:2.0:1787572410.688285:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244297984:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572410.688365:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244297984:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 81us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572410.688389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 128 00000100:00100000:2.0:1787572410.688406:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 129 00000100:00100000:2.0:1787572410.688413:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244297856:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572410.688437:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244297856:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 25us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572410.688443:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 129 00000100:00080000:3.0:1787572410.688652:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572410.690169:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244297728 00000100:00100000:0.0:1787572410.690183:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244297728 00000100:00100000:0.0:1787572410.690238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 283 00000100:00100000:0.0:1787572410.690247:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244297728:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572410.690311:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244297728:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 64us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572410.690319:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 283 00000100:00100000:0.0:1787572410.862997:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572410.863026:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268453248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572410.863107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572410.863894:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268453248 00000100:00100000:2.0:1787572410.863905:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268453248 00000100:00100000:2.0:1787572410.863964:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787572410.863977:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268453248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572410.864023:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572410.864093:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268453248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572410.864100:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787572410.864839:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40c4700 x1874405268453248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572410.864862:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268453248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787572411.183495:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572412.207934:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572413.230853:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787572414.063256:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787572414.269329:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572414.958979:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268453760:0@lo:400:kworker.0 00000100:00100000:1.0:1787572414.959062:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572414.959126:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787572414.959133:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268453632:0@lo:400:kworker.0 00000100:00100000:1.0:1787572414.959158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572414.959193:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268453632 00000100:00100000:1.0:1787572414.959202:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268453632 00000100:00100000:1.0:1787572414.959255:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787572414.959265:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268453632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572414.959313:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268453632:12345-0@lo:400:kworker.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572414.959320:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787572414.959360:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268453632:0@lo:400:kworker.0 00000100:00100000:0.0:1787572414.959663:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268453504:0@lo:400:kworker.0 00000100:00100000:0.0:1787572414.959708:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572414.959737:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268454016:0@lo:400:kworker.0 00000100:00100000:0.0:1787572414.959759:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572414.959803:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787572414.959809:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268453376:0@lo:400:kworker.0 00000100:00100000:0.0:1787572414.959834:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572414.959855:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268453888:0@lo:400:kworker.0 00000100:00100000:0.0:1787572414.959874:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572414.959898:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268453376 00000100:00100000:0.0:1787572414.959902:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268453376 00000100:00100000:0.0:1787572414.959926:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787572414.959932:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268453376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572414.959977:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268453376:12345-0@lo:400:kworker.0 Request processed in 45us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572414.959984:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787572414.960012:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268453504 00000100:00100000:0.0:1787572414.960016:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268453504 00000100:00100000:2.0:1787572414.960115:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268453760 00000100:00100000:2.0:1787572414.960120:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268453760 00000100:00100000:2.0:1787572414.960147:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268454016 00000100:00100000:2.0:1787572414.960150:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268454016 00000100:00100000:2.0:1787572414.960166:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787572414.960173:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268453760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572414.960209:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268453760:12345-0@lo:400:kworker.0 Request processed in 37us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572414.960215:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787572414.960227:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787572414.960233:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268454016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572414.960277:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268454016:12345-0@lo:400:kworker.0 Request processed in 44us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572414.960283:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787572414.960322:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268453888 00000100:00100000:2.0:1787572414.960326:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268453888 00000100:00100000:2.0:1787572414.960344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787572414.960349:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268453504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572414.960389:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268453504:12345-0@lo:400:kworker.0 Request processed in 40us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572414.960395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787572414.960407:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787572414.960413:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268453888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572414.960439:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268453888:12345-0@lo:400:kworker.0 Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572414.960445:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787572414.960476:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268453376:0@lo:400:kworker.0 00000100:00100000:2.0:1787572414.960487:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268453888:0@lo:400:kworker.0 00000100:00100000:2.0:1787572414.960495:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268453504:0@lo:400:kworker.0 00000100:00100000:2.0:1787572414.960504:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268454016:0@lo:400:kworker.0 00010000:00080000:1.0:1787572414.960807:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1d0b76d80 x1874405268453760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572414.960831:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268453760:0@lo:400:kworker.0 00000100:00080000:3.0:1787572414.960942:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572414.960947:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787572414.960950:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787572415.278929:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572415.471377:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787572415.471406:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268454144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572415.471516:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572415.471762:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268454144 00000100:00100000:2.0:1787572415.471772:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268454144 00000100:00100000:2.0:1787572415.471818:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787572415.471828:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268454144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572415.471882:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572415.471941:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268454144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572415.471949:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787572415.471999:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268454144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572415.807077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572415.807127:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572415.807158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572415.807188:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244298240 00000100:00100000:0.0:1787572415.807199:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244298240 00000100:00100000:0.0:1787572415.807349:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244298368 00000100:00100000:0.0:1787572415.807354:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244298368 00000100:00100000:3.0:1787572415.807408:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244298112 00000100:00100000:3.0:1787572415.807413:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244298112 00000100:00100000:3.0:1787572415.807443:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 285 00000100:00100000:3.0:1787572415.807464:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2355:x1874405244298112:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572415.807543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1e740fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2355:x1874405244298112:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 91us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572415.807551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 285 00000100:00100000:1.0:1787572415.808004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 133 00000100:00100000:1.0:1787572415.808015:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2355:x1874405244298240:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572415.808107:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2355:x1874405244298240:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 94us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572415.808114:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 133 00000100:00100000:1.0:1787572415.808132:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 134 00000100:00100000:1.0:1787572415.808138:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2355:x1874405244298368:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572415.808163:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2355:x1874405244298368:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 26us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572415.808169:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 134 00000100:00080000:0.0:1787572415.808250:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572415.983856:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572415.983934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572415.985013:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268454272 00000100:00100000:1.0:1787572415.985024:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268454272 00000100:00100000:1.0:1787572415.985072:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787572415.985083:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268454272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787572415.985145:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572415.985199:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268454272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572415.985207:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787572415.985351:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40c4700 x1874405268454272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572415.985373:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268454272:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787572416.030736:0:11859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:53:33 (1787572413) 00010000:00010000:1.0:1787572416.302859:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572417.327483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572418.041838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572418.042013:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244298496 00000100:00100000:1.0:1787572418.042028:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244298496 00000100:00080000:0.0:1787572418.042223:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572418.042513:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:1.0:1787572418.042527:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:10230:x1874405244298496:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572418.042549:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572418.042614:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f436567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db973 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572418.042738:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43656e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572418.042753:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43656e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572418.042770:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43656e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572418.042995:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787572418.042999:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572418.043094:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43656e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572418.043126:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f436567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db973 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572418.044053:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43656e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db973 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572418.044064:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572418.044067:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572418.044070:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030200, rc 0) 00000100:00100000:1.0:1787572418.044440:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:10230:x1874405244298496:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1916us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572418.044472:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:3.0:1787572418.055748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572418.058629:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244298624 00000100:00100000:0.0:1787572418.058657:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244298624 00000100:00100000:0.0:1787572418.058734:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:0.0:1787572418.058764:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:10231:x1874405244298624:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572418.058785:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572418.058809:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436575 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db97a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.058883:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.058899:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.058921:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.058947:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.058955:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.058961:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059612:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670e00/0x9fe530ef4f43658a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059623:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670e00/0x9fe530ef4f43658a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059632:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670e00/0x9fe530ef4f43658a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572418.059765:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787572418.059769:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572418.059853:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670e00/0x9fe530ef4f43658a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059865:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059872:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059879:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059885:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572418.059890:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059897:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059911:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:0.0:1787572418.059915:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572418.059919:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059925:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43657c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059938:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059954:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059960:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059964:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572418.059967:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059972:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059980:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98d1e1353600) 00010000:00010000:0.0:1787572418.059983:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572418.059985:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.059991:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436583 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.060025:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436575 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db97a expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.060039:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670e00/0x9fe530ef4f43658a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db97a expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572418.060047:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d1e1353200) 00010000:00010000:0.0:1787572418.060049:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572418.060058:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670e00, rc 0) 00000100:00100000:0.0:1787572418.060618:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:10231:x1874405244298624:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1854us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572418.060628:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1787572418.074291:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572418.074911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244298880 00000100:00100000:2.0:1787572418.074923:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244298880 00000100:00100000:2.0:1787572418.074997:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:2.0:1787572418.075009:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:10231:x1874405244298880:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787572418.075033:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572418.075055:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276000/0x9fe530ef4f436591 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db981 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572418.075134:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572418.075422:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572418.075437:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572418.075527:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572418.075536:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572418.075544:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077529:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea000/0x9fe530ef4f4365a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077549:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea000/0x9fe530ef4f4365a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077560:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea000/0x9fe530ef4f4365a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572418.077572:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787572418.077808:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077817:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077823:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077828:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572418.077833:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077846:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077857:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d1e1353200) 00010000:00010000:3.0:1787572418.077860:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572418.077866:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077872:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436598 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077884:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077890:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077895:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077913:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572418.077916:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.077922:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.079091:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98d1c3a46500) 00010000:00010000:3.0:1787572418.079099:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572418.079106:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.079128:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f43659f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.079895:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276000/0x9fe530ef4f436591 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db981 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.079926:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea000/0x9fe530ef4f4365a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db981 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572418.080555:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:3.0:1787572418.080558:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572418.080561:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea000, rc 0) 00000100:00100000:3.0:1787572418.080743:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:10231:x1874405244298880:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 5733us (6460us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787572418.080753:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:3.0:1787572418.087946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572418.088368:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244299008 00000100:00100000:1.0:1787572418.088381:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244299008 00000100:00100000:1.0:1787572418.088448:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:1.0:1787572418.088471:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:10231:x1874405244299008:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787572418.088590:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:10231:x1874405244299008:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 Request processed in 121us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572418.088599:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00000040:00080000:2.0:1787572418.159344:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787572418.352263:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572419.374828:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572420.080191:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268454528:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080264:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572420.080322:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268455040:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080348:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572420.080379:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787572420.080385:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268454400:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080423:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572420.080446:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268454912:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572420.080495:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268454656:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080518:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572420.080544:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572420.080549:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268454784:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080570:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572420.080600:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268455040 00000100:00100000:2.0:1787572420.080607:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268455040 00000100:00100000:2.0:1787572420.080698:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268454784 00000100:00100000:2.0:1787572420.080702:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268454784 00000100:00100000:2.0:1787572420.080722:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787572420.080731:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268455040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080782:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268455040:12345-0@lo:400:kworker.0 Request processed in 52us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.080789:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787572420.080806:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787572420.080812:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268454784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080843:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268454784:12345-0@lo:400:kworker.0 Request processed in 31us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.080849:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787572420.080869:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268454400 00000100:00100000:2.0:1787572420.080873:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268454400 00000100:00100000:2.0:1787572420.080897:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787572420.080902:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268454400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.080930:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268454400:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.080936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787572420.080964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268454528 00000100:00100000:2.0:1787572420.080968:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268454528 00000100:00100000:2.0:1787572420.080991:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268454912 00000100:00100000:2.0:1787572420.080994:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268454912 00000100:00100000:2.0:1787572420.081006:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268454656 00000100:00100000:2.0:1787572420.081008:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268454656 00000100:00100000:2.0:1787572420.081024:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787572420.081030:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268454528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.081059:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268454528:12345-0@lo:400:kworker.0 Request processed in 30us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.081071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787572420.081084:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787572420.081089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268454912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.081117:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268454912:12345-0@lo:400:kworker.0 Request processed in 28us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.081122:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787572420.081133:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787572420.081139:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268454656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.081162:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268454656:12345-0@lo:400:kworker.0 Request processed in 24us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.081167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1787572420.081187:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787572420.081191:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572420.081193:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787572420.081227:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f40c4380 x1874405268454784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787572436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572420.081241:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268454784:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.081252:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268454656:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.081278:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268454400:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.081288:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268454912:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.081297:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268454528:0@lo:400:kworker.0 00000100:00100000:2.0:1787572420.081305:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268455040:0@lo:400:kworker.0 00000100:00100000:1.0:1787572420.195039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.195117:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244299136 00000100:00100000:2.0:1787572420.195133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244299136 00000100:00100000:2.0:1787572420.195207:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:2.0:1787572420.195217:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:10274:x1874405244299136:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572420.195237:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572420.195255:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f4365b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db988 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.195327:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.195341:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.195362:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.195616:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.195626:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.195675:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.195991:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196000:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196007:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196018:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572420.196023:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196030:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196042:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:2.0:1787572420.196044:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572420.196049:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196054:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196065:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196071:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196077:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196082:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572420.196084:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196090:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196107:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98d1c3a46f00) 00010000:00010000:2.0:1787572420.196109:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572420.196112:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196118:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196152:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f4365b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db988 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196162:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:2.0:1787572420.196165:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572420.196169:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f4365b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db988 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.196179:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277400, rc 0) 00000100:00100000:2.0:1787572420.196233:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:10274:x1874405244299136:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1017us (1202us total) trans 0 rc 301/301 00000100:00100000:2.0:1787572420.196240:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00080000:3.0:1787572420.196324:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572420.213522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572420.214730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244299392 00000100:00100000:1.0:1787572420.214742:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244299392 00000100:00100000:1.0:1787572420.214805:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:1.0:1787572420.214816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:10274:x1874405244299392:12345-192.168.204.55@tcp:36:lfs.0 00010000:00010000:1.0:1787572420.214871:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572420.214898:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43656e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db973 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.214917:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572420.214927:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572420.215221:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.215234:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.215253:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.215264:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.215271:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.215277:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572420.216746:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787572420.216760:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.216769:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.216776:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.216782:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572420.216786:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.216794:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.216805:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:1.0:1787572420.216808:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572420.216818:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.216824:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365c9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572420.216841:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092e9d079 reply state 00000000d00746b1 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572420.216849:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787572420.216952:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:10274:x1874405244299392:12345-192.168.204.55@tcp:36:lfs.0 Request processed in 2136us (3437us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787572420.216961:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00010000:00010000:2.0:1787572420.236839:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.236857:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.236865:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.236882:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572420.236887:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.236895:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.236913:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98d1d0b0b200) 00010000:00010000:2.0:1787572420.236916:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572420.236921:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.236927:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4365d0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572420.369497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572420.369826:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244299520 00000100:00100000:1.0:1787572420.369837:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244299520 00000100:00100000:1.0:1787572420.369915:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:1.0:1787572420.369926:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:10282:x1874405244299520:12345-192.168.204.55@tcp:101:lctl.0 00010000:00010000:1.0:1787572420.369954:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572420.369979:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db98f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.370050:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4365de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.370063:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4365de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.370073:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4365de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572420.370133:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787572420.370150:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572420.370202:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4365de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.370230:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4365d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db98f expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.370250:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4365de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db98f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.370258:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:1.0:1787572420.370260:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572420.370263:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030200, rc 0) 00000100:00100000:1.0:1787572420.370332:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:10282:x1874405244299520:12345-192.168.204.55@tcp:101:lctl.0 Request processed in 409us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572420.370340:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00010000:00010000:1.0:1787572420.399972:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572420.505281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.506096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244299648 00000100:00100000:2.0:1787572420.506109:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244299648 00000100:00100000:2.0:1787572420.506184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:2.0:1787572420.506196:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:10288:x1874405244299648:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572420.506218:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572420.506241:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db996 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506313:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506326:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506358:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506373:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506381:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506387:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506518:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276000/0x9fe530ef4f4365fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506527:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276000/0x9fe530ef4f4365fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506535:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276000/0x9fe530ef4f4365fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572420.506574:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787572420.506578:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572420.506630:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276000/0x9fe530ef4f4365fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506683:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506691:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506708:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506714:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572420.506719:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506726:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506740:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:2.0:1787572420.506744:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572420.506750:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506756:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f4365ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506781:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506787:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506793:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506797:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572420.506800:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506815:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506825:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98d1c3a46f00) 00010000:00010000:2.0:1787572420.506827:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572420.506830:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506835:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f4365f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506946:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f4365e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db996 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506961:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276000/0x9fe530ef4f4365fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db996 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.506969:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:2.0:1787572420.506971:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787572420.506974:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276000, rc 0) 00000100:00100000:2.0:1787572420.507106:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:10288:x1874405244299648:12345-192.168.204.55@tcp:101:bash.0 Request processed in 913us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.507114:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:1.0:1787572420.523432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.523531:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244299904 00000100:00100000:2.0:1787572420.523541:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244299904 00000100:00100000:2.0:1787572420.523609:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:2.0:1787572420.523621:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:10288:x1874405244299904:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572420.523692:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572420.523714:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436601 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db99d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.523865:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.523879:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.523890:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.525261:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.525279:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.525288:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787572420.525916:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787572420.526087:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526096:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526104:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526155:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526161:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526168:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526175:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572420.526180:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526188:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526200:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:2.0:1787572420.526203:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572420.526207:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526214:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436608 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787572420.526227:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000665dd685 reply state 00000000b595aaab transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572420.526236:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787572420.526271:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436601 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526300:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.526307:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46900) 00010000:00010000:2.0:1787572420.526309:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572420.526311:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277400, rc 0) 00000100:00100000:2.0:1787572420.537889:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10288:x1874405244299904:12345-192.168.204.55@tcp:101:bash.0 Request processed in 14258us (14457us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787572420.537904:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00010000:00010000:2.0:1787572420.543222:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.543241:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.543249:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.543255:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572420.543259:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.543267:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.543285:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c3a46f00) 00010000:00010000:2.0:1787572420.543289:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572420.543293:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.543314:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43660f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572420.549275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.549370:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244300032 00000100:00100000:2.0:1787572420.549381:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244300032 00000100:00100000:2.0:1787572420.549445:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:2.0:1787572420.549454:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874405244300032:12345-192.168.204.55@tcp:8:bash.0 00010000:00080000:2.0:1787572420.549485:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:2.0:1787572420.549520:0:6693:0:(genops.c:1385:class_connect()) connect: client 6d499b5b-e864-4e70-bf3c-7c3a42e124cd, cookie 0x9fe530ef4f436624 00002000:00100000:2.0:1787572420.549531:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6d499b5b-e864-4e70-bf3c-7c3a42e124cd/ffff98d1d0aff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787572420.549555:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787572420.549824:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787572420.549854:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98d1d0afc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572420.549926:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2352:x1874405244300032:12345-192.168.204.55@tcp:8:bash.0 Request processed in 471us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.549934:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:0.0:1787572420.566080:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.566241:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244300160 00000100:00100000:2.0:1787572420.566252:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244300160 00000100:00100000:2.0:1787572420.566336:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1787572420.566347:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:0:x1874405244300160:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572420.566374:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572420.566398:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572420.566438:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787572420.566471:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1787572420.566475:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572420.566485:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.566508:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.566521:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276a00, rc 0) 00000100:00100000:2.0:1787572420.566588:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:0:x1874405244300160:12345-192.168.204.55@tcp:101:bash.0 Request processed in 242us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.566596:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00080000:3.0:1787572420.568242:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787572420.577026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572420.577223:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244300288 00000100:00100000:0.0:1787572420.577235:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244300288 00000100:00100000:0.0:1787572420.577299:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:0.0:1787572420.577312:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:10288:x1874405244300288:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572420.577333:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572420.577355:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9ab expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572420.577473:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572420.577484:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572420.577489:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572420.577494:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572420.577529:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572420.577545:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 8 pid: 6690 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572420.577573:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874405268455168:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572420.580745:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e75ce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572420.593788:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787572420.593810:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268455296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572420.593881:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572420.594133:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268455296 00000100:00100000:2.0:1787572420.594141:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268455296 00000100:00100000:2.0:1787572420.594203:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787572420.594212:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268455296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572420.594250:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572420.594305:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268455296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.594312:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787572420.594455:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268455296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572420.597784:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874405268455168:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572420.597825:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.597846:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671800, rc 0) 00000100:00100000:2.0:1787572420.597908:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:10288:x1874405244300288:12345-192.168.204.55@tcp:101:bash.0 Request processed in 20598us (20892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.597933:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:0.0:1787572420.599705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572420.599804:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244300416 00000100:00100000:1.0:1787572420.599817:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244300416 00010000:00010000:1.0:1787572420.599871:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 8 pid: 6690 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572420.599930:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:1.0:1787572420.599941:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244300416:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572420.599958:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572420.599983:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 8 pid: 6690 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.599998:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 8 pid: 6690 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.600025:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f43662b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9a4 expref: 8 pid: 6690 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.600042:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572420.600047:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572420.600067:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.600078:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.600118:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572420.600133:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1874405268455424:192.168.204.55@tcp:105: 00000100:00100000:1.0:1787572420.600224:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572420.606702:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1874405268455424:192.168.204.55@tcp:105: 00010000:00010000:1.0:1787572420.606733:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572420.609579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572420.609673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244300672 00000100:00100000:3.0:1787572420.609683:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244300672 00000100:00100000:3.0:1787572420.609752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1787572420.609764:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10288:x1874405244300672:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:1.0:1787572420.611037:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244300416:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 11092us (11334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572420.611049:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:2.0:1787572420.615787:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10288:x1874405244300672:12345-192.168.204.55@tcp:35:bash.0 Request processed in 6002us (6192us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787572420.615803:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1787572420.732753:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.733000:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244300928 00000100:00100000:2.0:1787572420.733010:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244300928 00000100:00100000:2.0:1787572420.733076:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1787572420.733087:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10298:x1874405244300928:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572420.733124:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572420.733146:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9b2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572420.733268:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787572420.733422:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436639 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9b2 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.733439:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:2.0:1787572420.733442:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787572420.733447:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9b2 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.733462:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277c00, rc 0) 00000100:00100000:2.0:1787572420.733530:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10298:x1874405244300928:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 445us (788us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787572420.733538:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:3.0:1787572420.736531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.736690:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244301184 00000100:00100000:2.0:1787572420.736713:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244301184 00000100:00100000:2.0:1787572420.736786:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1787572420.736796:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10298:x1874405244301184:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1787572420.737059:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10298:x1874405244301184:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 263us (536us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787572420.737067:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:0.0:1787572420.890345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572420.890631:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244301312 00000100:00100000:3.0:1787572420.890669:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244301312 00000100:00100000:3.0:1787572420.890800:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:3.0:1787572420.890830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10304:x1874405244301312:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572420.890858:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572420.890882:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9b9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.890965:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f43664e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.890981:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f43664e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.890993:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f43664e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572420.891066:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787572420.891070:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572420.891097:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f43664e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.891124:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9b9 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.891143:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f43664e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9b9 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.891152:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572420.891155:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787572420.891159:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ebc00, rc 0) 00000100:00100000:3.0:1787572420.891244:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:10304:x1874405244301312:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 417us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572420.891260:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:0.0:1787572420.908076:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.909460:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244301568 00000100:00100000:2.0:1787572420.909475:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244301568 00000100:00100000:2.0:1787572420.909555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:2.0:1787572420.909566:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:10304:x1874405244301568:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572420.909588:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572420.909609:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436655 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9c0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.910024:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43665c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.910040:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43665c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.910053:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43665c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572420.910065:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787572420.910278:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9c0 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.910297:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43665c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9c0 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.910324:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46900) 00010000:00010000:2.0:1787572420.910327:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572420.910331:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277600, rc 0) 00000100:00100000:2.0:1787572420.910455:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10304:x1874405244301568:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 889us (2386us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787572420.910463:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1787572420.922192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572420.922797:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244301696 00000100:00100000:0.0:1787572420.922806:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244301696 00000100:00100000:0.0:1787572420.922879:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1787572420.922890:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:2354:x1874405244301696:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572420.922905:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572420.922934:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43665c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9c0 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572420.922953:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46900) 00010000:00010000:0.0:1787572420.922958:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572420.923020:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:2354:x1874405244301696:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 132us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572420.923027:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1787572420.926792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572420.926835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572420.926880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572420.926963:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244301824 00000100:00100000:1.0:1787572420.926974:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244301824 00000100:00100000:1.0:1787572420.927033:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 287 00000100:00100000:1.0:1787572420.927044:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2355:x1874405244301824:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572420.927123:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2355:x1874405244301824:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572420.927132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 287 00000100:00100000:3.0:1787572420.927469:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244302080 00000100:00100000:3.0:1787572420.927475:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244302080 00000100:00100000:3.0:1787572420.927533:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 138 00000100:00100000:3.0:1787572420.927541:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2355:x1874405244302080:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572420.927585:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2355:x1874405244302080:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 45us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572420.927592:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 138 00000100:00080000:1.0:1787572420.928288:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572420.928929:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244301952 00000100:00100000:2.0:1787572420.928937:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244301952 00000100:00100000:2.0:1787572420.928990:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:2.0:1787572420.929000:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244301952:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572420.929052:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244301952:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 54us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572420.929059:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:3.0:1787572420.929905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572420.929980:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244302336 00000100:00100000:1.0:1787572420.929986:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244302336 00000100:00100000:1.0:1787572420.930027:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:1.0:1787572420.930035:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10304:x1874405244302336:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572420.930052:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572420.930071:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f43666a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9c7 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.930165:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f436671 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.930179:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f436671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.930205:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f436671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572420.930217:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787572420.930337:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f43666a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9c7 expref: 21 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.930361:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f436671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9c7 expref: 20 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.930370:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46900) 00010000:00010000:1.0:1787572420.930372:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787572420.930376:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030600, rc 0) 00000100:00100000:1.0:1787572420.930427:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:10304:x1874405244302336:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 393us (524us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787572420.930434:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:0.0:1787572420.941260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.941374:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244302464 00000100:00100000:2.0:1787572420.941384:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244302464 00000100:00100000:2.0:1787572420.941486:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:2.0:1787572420.941496:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244302464:12345-192.168.204.55@tcp:1:lfs.0 00010000:00010000:2.0:1787572420.941541:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.941562:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.941571:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787572420.941588:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572420.941593:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.941629:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.941684:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 7 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572420.941700:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874405268455552:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572420.942418:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c11ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1787572420.947165:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874405268455552:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572420.947196:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572420.947355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572420.947469:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244302592 00000100:00100000:1.0:1787572420.947490:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244302592 00002000:00100000:1.0:1787572420.947558:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98d1f40eca80 x1874405244302592/t0(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:456/0 lens 504/0 e 0 to 0 dl 1787572431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787572420.947568:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f40eca80 with x1874405244302592 ext(0->12) 00010000:00010000:1.0:1787572420.947576:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 8 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.947603:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 8 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787572420.947612:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d1f40eca80 00000100:00100000:1.0:1787572420.947663:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:1.0:1787572420.947674:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244302592:12345-192.168.204.55@tcp:4:lfs.0 00000001:00100000:2.0:1787572420.987575:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000100:00100000:1.0:1787572420.988312:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2353:x1874405244302592:12345-192.168.204.55@tcp:4:lfs.0 Request processed in 40632us (40950us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787572420.988324:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00002000:00100000:1.0:1787572420.988339:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98d1f40eca80 x1874405244302592/t4294967299(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:456/0 lens 504/448 e 0 to 0 dl 1787572431 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787572420.988349:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f40eca80 with x1874405244302592 ext(0->12) 00010000:00010000:1.0:1787572420.988360:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 9 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.988377:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 9 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787572420.988384:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d1f40eca80 00000100:00100000:0.0:1787572420.991810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572420.991880:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244302720 00000100:00100000:3.0:1787572420.991889:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244302720 00010000:00010000:3.0:1787572420.991923:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 9 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572420.991965:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:3.0:1787572420.991976:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2353:x1874405244302720:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572420.991990:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787572420.992010:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787572420.992013:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787572418 00002000:00010000:3.0:1787572420.992015:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787572419 00002000:00010000:3.0:1787572420.992017:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787572418 00010000:00010000:3.0:1787572420.992024:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 9 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.992147:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 9 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.992203:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f436632 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ab expref: 9 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.992221:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572420.992226:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572420.992231:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.992240:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572420.992271:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572420.992317:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244302720:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 344us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572420.992323:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00010000:00010000:1.0:1787572420.992383:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.992405:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.992455:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.992464:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.992477:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.992483:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572420.992488:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.992505:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.992519:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572420.992527:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000129f988f/0x9fe530ef4f43667f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572420.992590:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244302464:12345-192.168.204.55@tcp:1:lfs.0 Request processed in 51094us (51338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572420.992598:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:0.0:1787572420.994314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572420.994513:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244302976 00000100:00100000:2.0:1787572420.994522:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244302976 00000100:00100000:2.0:1787572420.994611:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:2.0:1787572420.994622:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:10304:x1874405244302976:12345-192.168.204.55@tcp:35:lfs.0 00000004:00010000:2.0:1787572420.995015:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f436671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9c7 expref: 20 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572420.995370:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787572420.995447:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787572420.997203:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787572420.997278:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.997298:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.997318:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.997758:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572420.997774:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 24 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572420.997790:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1874405268455680:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572420.997938:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787572421.002558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572421.002773:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244303104 00000100:00100000:1.0:1787572421.002782:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244303104 00010000:00010000:1.0:1787572421.002824:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 25 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572421.002860:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:1.0:1787572421.002875:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:2354:x1874405244303104:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572421.002890:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572421.002897:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 25 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.002912:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 25 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.002934:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46900) 00010000:00010000:1.0:1787572421.002939:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.002949:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.002957:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.002974:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572421.003029:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:2354:x1874405244303104:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 156us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572421.003037:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00010000:00010000:2.0:1787572421.004428:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db99d expref: 24 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572421.004454:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1874405268455680:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572421.004478:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.004501:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.004508:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572421.005135:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787572421.005334:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787572421.005461:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874405268455808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787572421.005536:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572421.005578:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787572421.005691:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268455808 00000100:00100000:3.0:1787572421.005698:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268455808 00000100:00100000:3.0:1787572421.005754:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572421.005764:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874405268455808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787572421.005840:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874405268455808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572421.005847:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572421.005894:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874405268455808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787572421.006546:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787572421.006606:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40efb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874405268455936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787572421.006687:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572421.006710:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e75ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572421.006722:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268455936 00000100:00100000:2.0:1787572421.006727:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268455936 00000100:00100000:2.0:1787572421.006768:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572421.006776:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874405268455936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787572421.006959:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1874405268455936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 183us (271us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787572421.006967:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787572421.007126:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40efb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874405268455936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787572421.007170:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787572421.007206:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.007216:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.007224:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.007229:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572421.007234:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.007241:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.007256:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46900) 00010000:00010000:3.0:1787572421.007259:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787572421.007264:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.007271:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436686 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787572421.007454:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787572421.007669:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787572421.007694:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351104058096ns, next at 352104043331ns, rc = 0 00000001:00080000:3.0:1787572421.007701:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787572421.007733:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46900) 00010000:00010000:3.0:1787572421.007736:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787572421.007743:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f436671 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9c7 expref: 28 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572421.007842:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:10304:x1874405244302976:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 13223us (13533us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787572421.007852:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000020:00080000:3.0:1787572421.007856:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787572421.010861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572421.010995:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244303232 00000100:00100000:3.0:1787572421.011005:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244303232 00000100:00100000:3.0:1787572421.011066:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:3.0:1787572421.011076:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:10304:x1874405244303232:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572421.011102:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572421.011124:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f43668d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9ce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.011193:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f43668d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ce expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.011208:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f43668d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ce expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.011240:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:3.0:1787572421.011243:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572421.011247:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eaa00, rc 0) 00000100:00100000:3.0:1787572421.011306:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:10304:x1874405244303232:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 232us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572421.011313:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:0.0:1787572421.018300:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572421.018365:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244303488 00000100:00100000:1.0:1787572421.018390:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244303488 00000100:00100000:1.0:1787572421.018512:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1787572421.018526:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7481450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:10304:x1874405244303488:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:1.0:1787572421.018928:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7481450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:10304:x1874405244303488:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 405us (637us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787572421.019167:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:0.0:1787572421.080920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572421.081040:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244303744 00000100:00100000:1.0:1787572421.081052:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244303744 00000100:00100000:1.0:1787572421.081168:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:1.0:1787572421.081181:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:10314:x1874405244303744:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572421.081210:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572421.081233:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f436694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9d5 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572421.081467:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787572421.081597:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f436694 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9d5 expref: 31 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.081611:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:1.0:1787572421.081614:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572421.081619:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f436694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9d5 expref: 31 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.081669:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030e00, rc 0) 00000100:00100000:1.0:1787572421.081731:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:10314:x1874405244303744:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 554us (821us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787572421.081739:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:0.0:1787572421.085383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572421.085540:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244303872 00000100:00100000:3.0:1787572421.085551:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244303872 00000100:00100000:3.0:1787572421.085612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:3.0:1787572421.085630:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:10314:x1874405244303872:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:3.0:1787572421.088014:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.088033:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.088045:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.088059:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.088065:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.088070:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.088810:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.088833:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089026:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787572421.089069:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089081:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089088:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089096:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089209:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572421.089213:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089220:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089232:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572421.089236:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572421.089240:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089247:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089265:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089272:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089278:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089283:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572421.089286:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089291:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089298:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c577c300) 00010000:00010000:3.0:1787572421.089301:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572421.089303:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089309:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089323:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089329:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089335:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089343:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eac00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572421.089347:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089352:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089359:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:3.0:1787572421.089361:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572421.089363:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.089368:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572421.089472:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:10314:x1874405244303872:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 3847us (4093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572421.089481:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1787572421.093236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572421.093338:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244304128 00000100:00100000:3.0:1787572421.093350:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244304128 00000100:00100000:3.0:1787572421.093465:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1787572421.093477:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:10314:x1874405244304128:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1787572421.093888:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:10314:x1874405244304128:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 412us (660us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787572421.093896:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1787572421.103188:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f42fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268456064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572421.103260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572421.103298:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268456064 00000100:00100000:2.0:1787572421.103308:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268456064 00000100:00100000:2.0:1787572421.103382:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787572421.103404:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874405268456064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572421.103429:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572421.103486:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874405268456064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572421.103493:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787572421.103525:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f42fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268456064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572421.143806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572421.143910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244304384 00000100:00100000:3.0:1787572421.143920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244304384 00000100:00100000:3.0:1787572421.143992:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1787572421.144003:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:10317:x1874405244304384:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572421.144034:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572421.144058:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9dc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.144143:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.144160:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.144173:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.144732:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.144745:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.144756:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148375:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148416:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148428:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572421.148442:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787572421.148705:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148714:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148722:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148729:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572421.148733:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148740:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148754:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:2.0:1787572421.148757:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572421.148760:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148766:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f4366be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148790:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148801:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148807:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148813:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572421.148816:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148822:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148829:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c3a46300) 00010000:00010000:2.0:1787572421.148831:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572421.148834:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148840:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4366c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148891:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4366b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148905:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.148913:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572421.148915:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572421.148922:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277a00, rc 0) 00000100:00100000:2.0:1787572421.148997:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10317:x1874405244304384:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 4995us (5202us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787572421.149007:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:0.0:1787572421.153080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572421.153291:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244304512 00000100:00100000:2.0:1787572421.153302:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244304512 00000100:00100000:2.0:1787572421.153358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:2.0:1787572421.153369:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10317:x1874405244304512:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:2.0:1787572421.153456:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153474:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153487:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153514:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153522:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153529:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153535:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572421.153539:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153547:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153567:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572421.153570:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787572421.153575:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.153582:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4366da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572421.153676:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10317:x1874405244304512:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 309us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572421.153684:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:0.0:1787572421.168814:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572421.168854:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244304768 00000100:00100000:0.0:1787572421.168864:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244304768 00000100:00100000:0.0:1787572421.168915:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:0.0:1787572421.168926:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10317:x1874405244304768:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572421.169154:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10317:x1874405244304768:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 228us (349us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787572421.169163:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000001:00080000:1.0:1787572421.189717:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967327 is committed 00000001:00080000:1.0:1787572421.189774:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967328 is committed 00000004:00080000:1.0:1787572421.189788:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787572421.189815:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d1d143d3c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787572421.189823:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1f3f57500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d1c90ed900 00000020:00080000:1.0:1787572421.189826:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1f3f57b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d1f44a0400 00000100:00100000:0.0:1787572421.190186:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787572421.190217:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f42fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268456192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787572421.190314:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572421.190430:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268456192 00000100:00100000:0.0:1787572421.190440:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268456192 00000100:00100000:0.0:1787572421.190503:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787572421.190513:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874405268456192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787572421.190571:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787572421.190626:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c30c2, atime: 0x6a8c30c3, ctime: 0x6a8c30c2, blocks: 0x1 00010000:00010000:0.0:1787572421.190660:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.190683:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1787572421.190688:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572421.190695:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.190714:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.190725:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.190735:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.190756:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787572421.191420:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1874405268456192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 906us (1105us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787572421.191429:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787572421.191467:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572421.191476:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.191500:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670a00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572421.191507:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.191518:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.191543:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.191550:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f4366e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.191574:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572421.191576:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572421.191579:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787572421.191619:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1f42fd500/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787572421.191625:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f42fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268456192:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1787572421.192112:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787572421.192200:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1787572421.427466:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572421.685246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572421.685339:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244305024 00000100:00100000:1.0:1787572421.685349:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244305024 00000100:00100000:1.0:1787572421.685418:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:1.0:1787572421.685428:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10348:x1874405244305024:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:1.0:1787572421.685455:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572421.685474:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4366e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9e3 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.685576:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4366ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.685591:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4366ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.685614:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4366ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572421.685626:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787572421.685793:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4366e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9e3 expref: 17 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.685812:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4366ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9e3 expref: 16 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.685845:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572421.685849:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787572421.685852:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0031e00, rc 0) 00000100:00100000:1.0:1787572421.685909:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10348:x1874405244305024:12345-192.168.204.55@tcp:101:cat.0 Request processed in 482us (672us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787572421.685917:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:0.0:1787572421.707479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572421.707714:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244305280 00000100:00100000:1.0:1787572421.707725:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244305280 00000100:00100000:0.0:1787572421.707758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572421.707802:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:1.0:1787572421.707814:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10348:x1874405244305280:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:2.0:1787572421.708804:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244305408 00000100:00100000:2.0:1787572421.708812:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244305408 00000100:00100000:2.0:1787572421.708873:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:2.0:1787572421.708882:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d16d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:2353:x1874405244305408:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572421.708894:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572421.708919:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4366ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9e3 expref: 18 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.708938:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572421.708943:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572421.708999:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d16d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:2353:x1874405244305408:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 118us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572421.709006:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:1.0:1787572421.709925:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10348:x1874405244305280:12345-192.168.204.55@tcp:35:cat.0 Request processed in 2109us (2453us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787572421.709935:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1787572421.810768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572421.811442:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244305664 00000100:00100000:3.0:1787572421.811460:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244305664 00000100:00100000:3.0:1787572421.811565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:3.0:1787572421.811579:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10354:x1874405244305664:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:3.0:1787572421.811617:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572421.811622:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787572421.811897:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f43664e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9b9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.811925:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572421.811931:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572421.811950:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9ea expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.812268:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.812289:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.812300:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.812349:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572421.812450:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 16 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572421.812469:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268456320:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572421.812887:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c504f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787572421.816911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572421.817401:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268456320:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572421.817444:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572421.817753:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244305792 00000100:00100000:1.0:1787572421.817764:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244305792 00010000:00010000:1.0:1787572421.817813:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 17 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572421.817867:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:1.0:1787572421.817878:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:2354:x1874405244305792:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572421.817896:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572421.817903:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 17 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.817916:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 17 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.818440:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4366cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9dc expref: 17 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.818464:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572421.818471:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.818481:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.818489:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.818528:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572421.818604:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:2354:x1874405244305792:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 725us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572421.818612:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00010000:00010000:0.0:1787572421.820043:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.820072:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572421.820132:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787572421.820790:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4366fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.820817:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572421.820829:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:0.0:1787572421.820832:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787572421.820837:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ebe00, rc 0) 00000100:00100000:0.0:1787572421.820915:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10354:x1874405244305664:12345-192.168.204.55@tcp:101:dd.0 Request processed in 9338us (10161us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787572421.820925:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:2.0:1787572421.829315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572421.829461:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244306048 00000100:00100000:1.0:1787572421.829476:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244306048 00000100:00100000:1.0:1787572421.829780:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:1.0:1787572421.829796:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10354:x1874405244306048:12345-192.168.204.55@tcp:36:dd.0 00010000:00010000:1.0:1787572421.830295:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.830319:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572421.830333:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572421.830430:0:7555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787572421.830460:0:7555:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f1e32d9 reply state 00000000a1b11f33 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572421.830470:0:7555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787572421.830830:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10354:x1874405244306048:12345-192.168.204.55@tcp:36:dd.0 Request processed in 1035us (1527us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787572421.830840:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00000020:00080000:1.0:1787572421.830847:0:7555:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787572421.835533:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.835556:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.835565:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.835579:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572421.835586:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.835595:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.835617:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572421.835621:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572421.835626:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572421.835782:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436712 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572422.108443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572422.108595:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244306176 00000100:00100000:0.0:1787572422.108609:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244306176 00000100:00100000:0.0:1787572422.108755:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:0.0:1787572422.108771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10368:x1874405244306176:12345-192.168.204.55@tcp:101:stat.0 00010000:00010000:0.0:1787572422.108808:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572422.108849:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f436719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9f1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.108956:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.108974:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787572422.109122:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787572422.109422:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.109447:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.109456:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.109463:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.110598:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.110622:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.110632:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.110721:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.110742:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 19 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572422.110763:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f42fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268456448:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572422.112039:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d9e129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572422.117058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572422.117226:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244306432 00000100:00100000:3.0:1787572422.117250:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244306432 00000100:00100000:3.0:1787572422.117327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1787572422.117340:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:5593:x1874405244306432:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787572422.117860:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:5593:x1874405244306432:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 521us (813us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787572422.117869:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:0.0:1787572422.118852:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f42fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268456448:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572422.118889:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572422.122132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572422.122464:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244306560 00000100:00100000:0.0:1787572422.122513:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244306560 00010000:00010000:0.0:1787572422.122573:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 21 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572422.122631:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:0.0:1787572422.122678:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:2354:x1874405244306560:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572422.122701:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572422.122710:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 21 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.122726:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 21 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.122756:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436704 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ea expref: 21 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.122779:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:0.0:1787572422.122786:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.122797:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.122807:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.122979:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572422.123070:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:2354:x1874405244306560:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 394us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572422.123079:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00010000:00010000:3.0:1787572422.124341:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124357:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572422.124440:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787572422.124446:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572422.124506:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124526:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124539:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124547:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124555:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124562:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572422.124567:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124576:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124595:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572422.124600:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572422.124607:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124631:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124708:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124714:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124722:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124728:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572422.124731:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124739:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124747:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1e1353000) 00010000:00010000:3.0:1787572422.124750:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572422.124753:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.124759:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.125341:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f436719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f1 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.125365:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f1 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.125396:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:3.0:1787572422.125399:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572422.125402:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671a00, rc 0) 00000100:00100000:3.0:1787572422.125513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10368:x1874405244306176:12345-192.168.204.55@tcp:101:stat.0 Request processed in 16746us (17088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572422.125526:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:3.0:1787572422.214457:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572422.214591:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244306816 00000100:00100000:2.0:1787572422.214628:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244306816 00000100:00100000:3.0:1787572422.215327:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:3.0:1787572422.215353:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10374:x1874405244306816:12345-192.168.204.55@tcp:36:truncate.0 00010000:00010000:3.0:1787572422.215467:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572422.215513:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43672e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f1 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.215539:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:3.0:1787572422.215545:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572422.216361:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.216404:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.216417:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787572422.216498:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787572422.216533:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094ac84f1 reply state 00000000506ed126 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572422.216567:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787572422.218422:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10374:x1874405244306816:12345-192.168.204.55@tcp:36:truncate.0 Request processed in 3063us (3968us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787572422.218439:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 54 00000020:00080000:3.0:1787572422.218451:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787572422.240955:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.240976:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.240984:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.240990:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572422.240995:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.241002:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.241021:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572422.241024:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572422.241029:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.241054:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436735 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.469620:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572422.521101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572422.521258:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244306944 00000100:00100000:2.0:1787572422.521273:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244306944 00000100:00100000:2.0:1787572422.521352:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:2.0:1787572422.521379:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:10388:x1874405244306944:12345-192.168.204.55@tcp:101:stat.0 00010000:00010000:2.0:1787572422.521421:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572422.521450:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43673c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9f8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.521546:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.521565:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.521579:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.521597:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.521605:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.521612:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523358:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523395:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523419:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572422.523474:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787572422.523479:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572422.523508:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523521:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523531:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523538:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523545:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523551:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572422.523555:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523562:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523576:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:2.0:1787572422.523580:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572422.523585:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523601:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436743 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523618:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523624:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523631:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523696:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572422.523699:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523705:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523713:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c3a46300) 00010000:00010000:2.0:1787572422.523715:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572422.523718:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523724:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f43674a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523773:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43673c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523786:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.523800:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572422.523802:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572422.523805:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277c00, rc 0) 00000100:00100000:2.0:1787572422.524325:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10388:x1874405244306944:12345-192.168.204.55@tcp:101:stat.0 Request processed in 2960us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572422.524335:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:3.0:1787572422.712008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572422.716286:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244307200 00000100:00100000:1.0:1787572422.716309:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244307200 00000100:00100000:3.0:1787572422.717477:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:3.0:1787572422.717511:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10398:x1874405244307200:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572422.717543:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572422.717575:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151db9ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572422.721426:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787572422.721811:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436758 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ff expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.721835:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:3.0:1787572422.721838:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787572422.721845:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ff expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.721863:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea800, rc 0) 00000100:00100000:3.0:1787572422.721982:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:10398:x1874405244307200:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 4488us (9988us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787572422.721994:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:1.0:1787572422.729608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572422.730297:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244307456 00000100:00100000:3.0:1787572422.730312:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244307456 00000100:00100000:3.0:1787572422.730412:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:3.0:1787572422.730424:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:10398:x1874405244307456:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1787572422.732686:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:10398:x1874405244307456:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 2249us (3080us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787572422.732702:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:0.0:1787572422.802149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572422.802577:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244307712 00000100:00100000:3.0:1787572422.802592:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244307712 00000100:00100000:3.0:1787572422.802723:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:3.0:1787572422.802737:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:10404:x1874405244307712:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1787572422.802791:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572422.802821:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436766 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba06 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.802966:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.802984:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.802995:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.803089:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572422.803107:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 24 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572422.803133:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268456576:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572422.813944:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2b51240 going to sleep for 11 seconds 00000100:00100000:1.0:1787572422.820783:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268456576:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572422.820787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:1.0:1787572422.820837:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572422.821762:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244307840 00000100:00100000:2.0:1787572422.821779:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244307840 00010000:00010000:2.0:1787572422.821834:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 25 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572422.821878:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:2.0:1787572422.821894:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:2354:x1874405244307840:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572422.821914:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572422.821923:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 25 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.821942:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 25 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.821972:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436751 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151db9f8 expref: 25 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.821991:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572422.821997:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.822032:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.822041:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.822097:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572422.822431:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.822442:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572422.822467:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787572422.822749:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436766 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.822782:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.822792:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572422.822795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787572422.822798:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea200, rc 0) 00000100:00100000:2.0:1787572422.822959:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:2354:x1874405244307840:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 1069us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572422.822970:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:1.0:1787572422.823736:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:10404:x1874405244307712:12345-192.168.204.55@tcp:101:bash.0 Request processed in 20998us (21598us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787572422.823769:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:3.0:1787572422.832487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572422.832858:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244308096 00000100:00100000:1.0:1787572422.832874:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244308096 00000100:00100000:1.0:1787572422.832951:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:1.0:1787572422.832967:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:10404:x1874405244308096:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:1.0:1787572422.833998:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.834029:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572422.834045:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572422.834267:0:7555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787572422.834311:0:7555:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c03d86e reply state 000000001913f5de transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572422.834323:0:7555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787572422.836675:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:10404:x1874405244308096:12345-192.168.204.55@tcp:36:bash.0 Request processed in 3675us (4166us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787572422.836702:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00000020:00080000:1.0:1787572422.836715:0:7555:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787572422.848873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:2.0:1787572422.850474:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.850499:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.850509:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.850516:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572422.850523:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.850532:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.850557:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572422.850561:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572422.850577:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.850613:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43677b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572422.851609:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244308224 00000100:00100000:3.0:1787572422.851625:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244308224 00000100:00100000:0.0:1787572422.851885:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:0.0:1787572422.851896:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:10404:x1874405244308224:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572422.851928:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572422.852001:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436782 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba0d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.852094:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.852111:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.852120:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.852562:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.852578:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 27 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572422.852610:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f42ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268456704:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572422.852787:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d9e129c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572422.859460:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f42ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268456704:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572422.859496:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572422.859928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572422.865592:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244308352 00000100:00100000:1.0:1787572422.865608:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244308352 00010000:00010000:0.0:1787572422.866292:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 28 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572422.866349:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:0.0:1787572422.866370:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:2353:x1874405244308352:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572422.866387:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572422.866395:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 28 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.866407:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 28 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.866435:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43676d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba06 expref: 28 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.866461:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:0.0:1787572422.866465:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.866501:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.866509:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572422.866541:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572422.866618:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:2353:x1874405244308352:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 259us (6690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572422.866625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00010000:00010000:2.0:1787572422.868029:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.868061:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572422.868142:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787572422.868149:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572422.868190:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.868246:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436782 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba0d expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.868268:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba0d expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572422.868279:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572422.868282:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572422.868287:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671200, rc 0) 00000100:00100000:2.0:1787572422.868397:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:10404:x1874405244308224:12345-192.168.204.55@tcp:101:bash.0 Request processed in 16501us (19533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572422.868407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:3.0:1787572422.878579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572422.878934:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244308608 00000100:00100000:1.0:1787572422.878945:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244308608 00000100:00100000:1.0:1787572422.879088:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1787572422.879101:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7483850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:10404:x1874405244308608:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:1.0:1787572422.879463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7483850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:10404:x1874405244308608:12345-192.168.204.55@tcp:35:bash.0 Request processed in 364us (894us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787572422.879472:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:3.0:1787572423.042326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572423.042542:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244308864 00000100:00100000:0.0:1787572423.042559:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244308864 00000100:00100000:0.0:1787572423.042680:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:0.0:1787572423.042694:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:10414:x1874405244308864:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572423.042732:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572423.042905:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f436790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572423.043269:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787572423.044559:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f436790 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba14 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572423.044586:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:0.0:1787572423.044589:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572423.044595:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f436790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba14 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572423.044614:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670000, rc 0) 00000100:00100000:0.0:1787572423.046023:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:10414:x1874405244308864:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 3320us (3714us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787572423.046037:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:0.0:1787572423.054286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572423.054469:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244308992 00000100:00100000:1.0:1787572423.054485:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244308992 00000100:00100000:1.0:1787572423.054569:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:1.0:1787572423.054582:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:10414:x1874405244308992:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:1.0:1787572423.054742:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.054775:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.054793:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.054820:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.054828:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.054835:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055280:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055293:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055784:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572423.055905:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055922:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055929:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055937:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055943:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572423.055948:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055956:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055973:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572423.055976:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572423.055982:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.055989:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f43679e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056008:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056022:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056030:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056036:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572423.056039:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056045:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056053:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572423.056057:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572423.056060:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056066:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056084:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056090:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056096:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056101:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572423.056112:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056119:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056127:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572423.056130:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572423.056133:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.056138:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572423.056418:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:10414:x1874405244308992:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 1832us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572423.056431:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:3.0:1787572423.063778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572423.065032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244309248 00000100:00100000:0.0:1787572423.065050:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244309248 00000100:00100000:0.0:1787572423.065136:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:0.0:1787572423.065148:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:10414:x1874405244309248:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572423.065864:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:10414:x1874405244309248:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 712us (2107us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787572423.065874:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:3.0:1787572423.144488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572423.144686:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244309504 00000100:00100000:1.0:1787572423.144701:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244309504 00000100:00100000:1.0:1787572423.144792:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:1.0:1787572423.144816:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:10417:x1874405244309504:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572423.144854:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572423.144882:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba1b expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145020:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145040:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145066:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145085:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145093:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145099:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145573:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145586:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145594:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572423.145605:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787572423.145796:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145805:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145812:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145819:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572423.145831:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145839:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145856:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572423.145860:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572423.145866:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145873:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4367ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145888:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145894:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145899:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145904:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572423.145907:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145912:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145919:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572423.145921:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572423.145931:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145937:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4367c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.145995:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba1b expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.146011:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba1b expref: 31 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.146018:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572423.146021:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787572423.146023:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0031000, rc 0) 00000100:00100000:1.0:1787572423.146124:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:10417:x1874405244309504:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1320us (1649us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787572423.146133:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:3.0:1787572423.150494:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572423.150948:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244309632 00000100:00100000:1.0:1787572423.150964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244309632 00000100:00100000:1.0:1787572423.151050:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:1.0:1787572423.151064:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:10417:x1874405244309632:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1787572423.151165:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151188:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151202:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151267:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151275:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151283:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151290:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572423.151296:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151317:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151457:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572423.151461:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572423.151468:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.151474:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572423.151577:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:10417:x1874405244309632:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 515us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572423.151586:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:3.0:1787572423.155221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572423.155710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572423.156193:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244310016 00000100:00100000:0.0:1787572423.156208:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244310016 00000100:00100000:0.0:1787572423.156312:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:0.0:1787572423.156327:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:10417:x1874405244310016:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572423.156728:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10417:x1874405244310016:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 403us (1018us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787572423.156737:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:1.0:1787572423.157574:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244309760 00000100:00100000:1.0:1787572423.157588:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244309760 00000100:00100000:1.0:1787572423.157689:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:1.0:1787572423.157721:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:2354:x1874405244309760:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572423.157739:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572423.157997:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba1b expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.158024:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572423.158030:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572423.158084:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:2354:x1874405244309760:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 366us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572423.158092:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:3.0:1787572423.454607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572423.455103:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244310272 00000100:00100000:1.0:1787572423.455116:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244310272 00000100:00100000:1.0:1787572423.455204:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:1.0:1787572423.455218:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:10435:x1874405244310272:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:1.0:1787572423.455256:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572423.455286:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba22 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.455437:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.455454:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.455468:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572423.455480:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787572423.455767:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba22 expref: 34 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.455792:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba22 expref: 33 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.455803:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:1.0:1787572423.455806:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787572423.455811:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0031800, rc 0) 00000100:00100000:1.0:1787572423.455901:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10435:x1874405244310272:12345-192.168.204.55@tcp:101:cat.0 Request processed in 685us (1309us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787572423.455909:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00010000:00010000:1.0:1787572423.471176:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572423.515831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572423.516230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244310400 00000100:00100000:1.0:1787572423.516244:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244310400 00000100:00100000:1.0:1787572423.516337:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:1.0:1787572423.516363:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10436:x1874405244310400:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572423.516401:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572423.516430:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba29 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.516523:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.516540:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.516553:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572423.516907:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787572423.516913:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572423.517371:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.517416:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4367f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba29 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.517439:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba29 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.517449:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572423.517453:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572423.517457:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030600, rc 0) 00000100:00100000:1.0:1787572423.517550:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10436:x1874405244310400:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1201us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572423.517560:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:3.0:1787572423.544916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572423.546251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244310784 00000100:00100000:0.0:1787572423.546272:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244310784 00000100:00100000:0.0:1787572423.546380:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:0.0:1787572423.546394:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10436:x1874405244310784:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572423.548785:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:10436:x1874405244310784:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 2379us (3882us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787572423.549021:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:0.0:1787572423.557592:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572423.557754:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244310912 00000100:00100000:2.0:1787572423.557769:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244310912 00000100:00100000:2.0:1787572423.557871:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:2.0:1787572423.557915:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:10436:x1874405244310912:12345-192.168.204.55@tcp:103:lfs.0 00010000:00010000:2.0:1787572423.557938:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787572423.557972:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436789 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba0d expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572423.558000:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4367e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba22 expref: 34 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572423.558014:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f43668d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db9ce expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572423.558027:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577cd00) 00010000:00010000:2.0:1787572423.558044:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572423.558308:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10436:x1874405244310912:12345-192.168.204.55@tcp:103:lfs.0 Request processed in 396us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572423.558317:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:0.0:1787572423.562037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572423.562218:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244311040 00000100:00100000:1.0:1787572423.562232:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244311040 00000100:00100000:1.0:1787572423.562360:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:1.0:1787572423.562375:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10436:x1874405244311040:12345-192.168.204.55@tcp:58:lfs.0 00010000:00010000:1.0:1787572423.562557:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.562578:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.562593:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787572423.567613:0:7555:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787572423.568249:0:7555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787572423.568487:0:7555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787572423.569223:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10436:x1874405244311040:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 6840us (7190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572423.569242:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:0.0:1787572423.623202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572423.623425:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244311168 00000100:00100000:1.0:1787572423.623440:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244311168 00000100:00100000:1.0:1787572423.626975:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:1.0:1787572423.627004:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10438:x1874405244311168:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572423.627038:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572423.628255:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f436807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba30 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.628756:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.628776:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.629415:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.629450:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.629459:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.629493:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.632305:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.632576:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.632594:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572423.632744:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787572423.632749:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572423.632777:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.633291:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.633310:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.633317:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634046:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634117:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572423.634123:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634155:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634175:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572423.634178:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572423.634183:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634190:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f43680e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634213:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634219:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634226:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634231:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572423.634234:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634239:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634245:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572423.634248:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572423.634250:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634264:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f436815 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634458:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f436807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634479:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572423.634487:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572423.634490:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572423.634492:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463800, rc 0) 00000100:00100000:1.0:1787572423.634687:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10438:x1874405244311168:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 7695us (11499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572423.634698:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00000040:00080000:1.0:1787572424.303047:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787572424.303064:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787572424.303131:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787572424.303140:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787572424.303618:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268456832:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787572424.303811:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c11ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1787572424.310378:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268456832:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787572424.310588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.310744:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244311296 00000100:00100000:0.0:1787572424.310754:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244311296 00000100:00100000:0.0:1787572424.310838:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1787572424.310851:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10449:x1874405244311296:12345-192.168.204.55@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787572424.310955:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10449:x1874405244311296:12345-192.168.204.55@tcp:900:lhsmtool_posix.0 Request processed in 107us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.310964:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00080000:1.0:1787572424.311667:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572424.322688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.322781:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244311424 00000100:00100000:0.0:1787572424.322796:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244311424 00000100:00100000:0.0:1787572424.322876:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:0.0:1787572424.322890:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10449:x1874405244311424:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787572424.323011:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787572424.323459:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10449:x1874405244311424:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 571us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.323470:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:1.0:1787572424.335204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572424.335263:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244311552 00000100:00100000:1.0:1787572424.335276:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244311552 00000100:00100000:1.0:1787572424.335384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:1.0:1787572424.335397:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10449:x1874405244311552:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787572424.335501:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.335523:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.335539:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.338775:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.338802:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.338817:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.338918:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.338929:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.338936:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572424.339054:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787572424.339059:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572424.339074:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339103:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339110:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339119:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339125:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572424.339130:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339138:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339151:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:1.0:1787572424.339154:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572424.339159:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339166:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436823 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339230:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339238:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339244:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339257:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572424.339260:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339266:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339275:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572424.339278:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572424.339281:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339286:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f43682a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339301:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339307:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339312:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339318:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572424.339321:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339327:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339355:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572424.339358:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572424.339361:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.339367:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572424.340309:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10449:x1874405244311552:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 4907us (5107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572424.340321:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:3.0:1787572424.343714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572424.345773:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244311808 00000100:00100000:1.0:1787572424.345794:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244311808 00000100:00100000:1.0:1787572424.345895:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:1.0:1787572424.345911:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10449:x1874405244311808:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572424.345936:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572424.345958:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436838 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346081:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346110:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572424.346123:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787572424.346556:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346564:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346571:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346577:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572424.346581:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346590:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346601:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572424.346604:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572424.346609:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.346615:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43683f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.347065:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436838 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba37 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.347079:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:1.0:1787572424.347081:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572424.347086:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436838 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba37 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.347114:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463400, rc 0) 00000100:00100000:1.0:1787572424.348115:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10449:x1874405244311808:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 2203us (4411us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787572424.348126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:0.0:1787572424.361183:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.361238:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244311936 00000100:00100000:0.0:1787572424.361251:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244311936 00000100:00100000:0.0:1787572424.362389:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:0.0:1787572424.362409:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10449:x1874405244311936:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787572424.362460:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787572424.362693:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10449:x1874405244311936:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 288us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.362705:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:0.0:1787572424.374496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.374549:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244312192 00000100:00100000:0.0:1787572424.374563:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244312192 00000100:00100000:0.0:1787572424.376589:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:0.0:1787572424.376611:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10449:x1874405244312192:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572424.376658:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572424.376714:0:7555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787572424.376755:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4367f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba29 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.376791:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:0.0:1787572424.376798:0:7555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572424.376818:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43684d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba3e expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787572424.378518:0:7555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787572424.378900:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436854 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.378921:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.378934:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.379506:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43684d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba3e expref: 36 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.379539:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba3e expref: 35 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.379549:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:0.0:1787572424.379552:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572424.379556:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671000, rc 0) 00000100:00100000:0.0:1787572424.379656:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:10449:x1874405244312192:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 3035us (5160us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787572424.379665:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:0.0:1787572424.387058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572424.387209:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244312448 00000100:00100000:1.0:1787572424.387220:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244312448 00000100:00100000:1.0:1787572424.387287:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00100000:1.0:1787572424.387299:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:10449:x1874405244312448:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787572424.387373:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572424.387415:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436854 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba3e expref: 35 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.387435:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:1.0:1787572424.387445:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572424.387469:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.387483:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.387494:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.387507:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.387513:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.387534:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388138:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388148:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388155:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388162:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572424.388167:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388185:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388197:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572424.388201:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572424.388205:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388211:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436862 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388224:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388231:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388247:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388254:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572424.388257:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388264:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388273:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2e94b8ad (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572424.388275:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572424.388278:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.388284:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436869 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2e94b8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572424.388477:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10449:x1874405244312448:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 1091us (1341us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787572424.388488:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00100000:0.0:1787572424.397889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572424.398169:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244312576 00000100:00100000:1.0:1787572424.398190:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244312576 00000100:00100000:1.0:1787572424.398267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:1.0:1787572424.398278:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10449:x1874405244312576:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572424.398301:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572424.398340:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436870 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.398512:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.398526:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.398538:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.398661:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.398683:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.398693:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:1.0:1787572424.398696:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787572424.398700:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462e00, rc 0) 00000100:00100000:1.0:1787572424.398766:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:10449:x1874405244312576:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 490us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572424.398774:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:3.0:1787572424.405075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572424.408226:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244312832 00000100:00100000:1.0:1787572424.408242:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244312832 00000100:00100000:1.0:1787572424.408614:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:1.0:1787572424.408628:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:10449:x1874405244312832:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787572424.408738:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.408776:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.408789:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787572424.410293:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787572424.410311:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354506674849ns, next at 355506671239ns, rc = 0 00000004:00010000:1.0:1787572424.411228:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e49b724e reply state 000000000f5e122a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572424.411243:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787572424.411604:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+37:10449:x1874405244312832:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 2976us (6969us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787572424.411614:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:3.0:1787572424.424370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.424449:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244312960 00000100:00100000:0.0:1787572424.424458:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244312960 00000100:00100000:0.0:1787572424.424523:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:0.0:1787572424.424534:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+37:10449:x1874405244312960:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572424.424559:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572424.424582:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba4c expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.424674:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 38 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.424690:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 38 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.424734:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:0.0:1787572424.424737:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787572424.424741:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671400, rc 0) 00000100:00100000:0.0:1787572424.424804:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:10449:x1874405244312960:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 271us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.424811:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00010000:00010000:1.0:1787572424.427958:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.428045:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.428056:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.428063:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00000100:00100000:3.0:1787572424.428533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.428616:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244313088 00000100:00100000:0.0:1787572424.428626:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244313088 00000100:00100000:0.0:1787572424.428702:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:0.0:1787572424.428713:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874405244313088:12345-192.168.204.55@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787572424.428746:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp t0 exp 0000000000000000 cur 354 last 0 00010000:00010000:1.0:1787572424.429385:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.429476:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.429506:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:1.0:1787572424.429509:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787572424.429515:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.429523:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f43687e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787572424.429657:0:6692:0:(genops.c:1385:class_connect()) connect: client 6d499b5b-e864-4e70-bf3c-7c3a42e124cd, cookie 0x9fe530ef4f43688c 00002000:00100000:0.0:1787572424.429671:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d499b5b-e864-4e70-bf3c-7c3a42e124cd/ffff98d1de1f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787572424.429696:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787572424.432675:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787572424.432727:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98d1c8aa4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787572424.432822:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2352:x1874405244313088:12345-192.168.204.55@tcp:8:lhsmtool_posix.0 Request processed in 4108us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.432835:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:2.0:1787572424.446459:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.447517:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244313216 00000100:00100000:0.0:1787572424.447529:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244313216 00000100:00100000:0.0:1787572424.447606:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:0.0:1787572424.447618:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:0:x1874405244313216:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787572424.448726:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787572424.504839:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572424.547806:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:0:x1874405244313216:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 100106us (101271us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787572424.547828:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000001:00080000:3.0:1787572424.547896:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1787572424.547912:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000100:00100000:3.0:1787572424.560143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572424.560230:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244313472 00000100:00100000:2.0:1787572424.560241:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244313472 00000100:00100000:2.0:1787572424.560300:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:2.0:1787572424.560311:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+37:10449:x1874405244313472:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787572424.560608:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:10449:x1874405244313472:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 298us (474us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787572424.560616:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:1.0:1787572424.587940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.588905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244313728 00000100:00100000:0.0:1787572424.588928:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244313728 00000100:00100000:0.0:1787572424.588998:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:0.0:1787572424.589009:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:10449:x1874405244313728:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787572424.590023:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:10449:x1874405244313728:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 1010us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.591166:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:0.0:1787572424.596536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.596588:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244313856 00000100:00100000:0.0:1787572424.596599:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244313856 00000100:00100000:0.0:1787572424.596673:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:0.0:1787572424.596685:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:10449:x1874405244313856:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572424.596710:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572424.596734:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f436893 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba53 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.596822:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43689a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.596836:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43689a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.596848:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43689a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572424.596885:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572424.596909:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43689a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.596937:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f436893 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba53 expref: 40 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.596964:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43689a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba53 expref: 39 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.596973:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:0.0:1787572424.596976:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787572424.596980:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671a00, rc 0) 00000100:00100000:0.0:1787572424.597047:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:10449:x1874405244313856:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 364us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.597054:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:0.0:1787572424.603606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572424.605138:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244313984 00000100:00100000:2.0:1787572424.605282:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244313984 00000100:00100000:2.0:1787572424.605397:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:2.0:1787572424.605410:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244313984:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787572424.605434:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572424.605458:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba5a expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572424.605494:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c30c6, blocks: 0x1 00010000:00010000:2.0:1787572424.605520:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1787572424.605524:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572424.605534:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.605555:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.605570:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276600, rc 0) 00000100:00100000:2.0:1787572424.605650:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244313984:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 227us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572424.605658:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:1.0:1787572424.610736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572424.610985:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244314240 00000100:00100000:3.0:1787572424.610996:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244314240 00000100:00100000:1.0:1787572424.611302:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:1.0:1787572424.611315:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:10449:x1874405244314240:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787572424.611460:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:10449:x1874405244314240:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 146us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572424.611470:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:0.0:1787572424.616392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572424.616498:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244314368 00000100:00100000:3.0:1787572424.616509:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244314368 00000100:00100000:3.0:1787572424.616604:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:3.0:1787572424.616616:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:10449:x1874405244314368:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572424.616662:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572424.616687:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba61 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.616721:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.616730:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572424.616734:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572424.616740:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.616793:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.616810:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 7 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572424.616838:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1874405268456960:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572424.616968:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d07e1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572424.623552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572424.624021:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244314496 00000100:00100000:1.0:1787572424.624034:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244314496 00010000:00010000:1.0:1787572424.624080:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 8 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572424.624188:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:1.0:1787572424.624199:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244314496:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572424.624216:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572424.624244:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 8 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.624265:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 8 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.624297:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572424.624301:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572424.624309:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.624320:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.624377:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572424.624392:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1874405268457088:192.168.204.55@tcp:105: 00000100:00100000:1.0:1787572424.624491:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1de013c00 going to sleep for 11 seconds 00010000:00010000:0.0:1787572424.624690:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e908232d/0x9fe530ef4f4368a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba5a expref: 8 pid: 6692 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572424.624707:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1874405268456960:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572424.624732:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.624743:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb000, rc 0) 00000100:00100000:0.0:1787572424.624772:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:10449:x1874405244314368:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 8159us (8394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.624780:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:3.0:1787572424.630030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572424.630210:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244314624 00000100:00100000:2.0:1787572424.630219:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244314624 00002000:00100000:2.0:1787572424.630285:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98d1f4512a00 x1874405244314624/t0(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:460/0 lens 504/0 e 0 to 0 dl 1787572435 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787572424.630285:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1874405268457088:192.168.204.55@tcp:105: 00002000:00100000:2.0:1787572424.630296:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f4512a00 with x1874405244314624 ext(0->8) 00002000:00010000:2.0:1787572424.630306:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f4512a00 00010000:00010000:0.0:1787572424.630315:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572424.630359:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:2.0:1787572424.630370:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244314624:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787572424.630396:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244314496:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 6191us (6848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.630406:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:2.0:1787572424.631090:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244314624:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 Request processed in 720us (1069us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787572424.631098:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00002000:00100000:2.0:1787572424.631105:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98d1f4512a00 x1874405244314624/t4294967302(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:460/0 lens 504/448 e 0 to 0 dl 1787572435 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572424.631114:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f4512a00 with x1874405244314624 ext(0->8) 00002000:00010000:2.0:1787572424.631119:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f4512a00 00000100:00100000:3.0:1787572424.641403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.641787:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244314752 00000100:00100000:0.0:1787572424.641798:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244314752 00000100:00100000:0.0:1787572424.641872:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:0.0:1787572424.641884:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:10449:x1874405244314752:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787572424.699253:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000100:00100000:0.0:1787572424.699406:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10449:x1874405244314752:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 57515us (58016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.699418:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00000001:00080000:2.0:1787572424.699513:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1787572424.699520:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1787572424.702907:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572424.702937:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268457216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787572424.702962:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.703285:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244314880 00000100:00100000:0.0:1787572424.703293:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244314880 00000100:00100000:0.0:1787572424.703415:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:0.0:1787572424.703426:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244314880:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787572424.703562:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1787572424.703569:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1787572424.703603:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787572424.703613:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787572424.703955:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572424.704103:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787572424.704111:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787572424.708126:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268457216 00000100:00100000:0.0:1787572424.708138:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268457216 00000100:00080000:1.0:1787572424.708302:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572424.714470:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787572424.714671:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268457216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787572424.715160:0:12010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787572424.715165:0:12010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787572422 00002000:00010000:0.0:1787572424.715167:0:12010:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787572424.715169:0:12010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787572422 -> 1787572422 00002000:00010000:0.0:1787572424.715171:0:12010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787572424.715264:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268457216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 780us (11308us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787572424.715288:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:3.0:1787572424.715406:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1f4513100/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787572424.715414:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268457216:0@lo:2:osp-syn-1-0.0 00000040:00080000:2.0:1787572424.770685:0:12014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787572424.770695:0:12014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787572424.770736:0:12014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787572424.770741:0:12014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787572424.806045:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244314880:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 102606us (103071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.806059:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000001:00080000:0.0:1787572424.806504:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1787572424.815889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572424.819091:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244315136 00000100:00100000:3.0:1787572424.819107:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244315136 00000100:00100000:3.0:1787572424.819174:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:3.0:1787572424.819185:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10449:x1874405244315136:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787572424.819242:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572424.819271:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43689a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba53 expref: 13 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.819289:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:3.0:1787572424.819294:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572424.819337:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.819352:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.819363:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787572424.819675:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7205ce6 reply state 00000000cfdc2d68 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572424.819698:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787572424.819813:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10449:x1874405244315136:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 630us (3933us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787572424.819821:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:0.0:1787572424.827002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:0.0:1787572424.827040:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.827053:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.827062:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.827069:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572424.827073:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.827081:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.827101:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:0.0:1787572424.827104:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572424.827109:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.827114:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572424.827178:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244315264 00000100:00100000:0.0:1787572424.827187:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244315264 00000100:00100000:0.0:1787572424.827244:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:0.0:1787572424.827254:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244315264:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787572424.827476:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787572424.827480:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787572422 -> 1787572421 00002000:00010000:0.0:1787572424.827482:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787572419 00002000:00010000:0.0:1787572424.827484:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787572422 -> 1787572421 00002000:00010000:0.0:1787572424.827486:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787572424.827550:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244315264:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 297us (559us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787572424.827558:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:0.0:1787572424.841584:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572424.841884:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244315520 00000100:00100000:3.0:1787572424.841897:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244315520 00000100:00100000:3.0:1787572424.842335:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:3.0:1787572424.842348:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10449:x1874405244315520:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787572424.842528:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.842546:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.842556:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.842616:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.842631:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 13 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572424.842675:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268457344:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572424.844525:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d07e1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787572424.847707:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268457344:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572424.847750:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572424.850675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572424.850751:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244315648 00000100:00100000:2.0:1787572424.850763:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244315648 00010000:00010000:2.0:1787572424.850818:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 14 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572424.850889:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:2.0:1787572424.850900:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:2354:x1874405244315648:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572424.850918:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572424.850925:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 14 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.850940:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 14 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.850962:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba45 expref: 14 pid: 5842 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.850978:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:2.0:1787572424.850982:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.850991:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.850998:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.851031:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572424.851078:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2354:x1874405244315648:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 180us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572424.851085:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00010000:00010000:1.0:1787572424.851514:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.851523:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.851552:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.851570:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.851578:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.851584:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572424.851588:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.851596:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.851607:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:1.0:1787572424.851609:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787572424.851613:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.851619:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572424.851706:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+12:10449:x1874405244315520:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 Request processed in 9361us (10142us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787572424.851716:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:3.0:1787572424.861692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.862252:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244315776 00000100:00100000:0.0:1787572424.862262:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244315776 00000100:00100000:0.0:1787572424.862313:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:0.0:1787572424.862333:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2356:x1874405244315776:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787572424.862421:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.862442:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.862450:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572424.862454:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787572424.862471:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.862509:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.862525:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 7 pid: 6693 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572424.862542:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268457472:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572424.862630:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572424.869904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572424.877092:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268457472:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572424.877122:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572424.877724:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244315904 00000100:00100000:2.0:1787572424.877740:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244315904 00010000:00010000:2.0:1787572424.877775:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 8 pid: 6693 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572424.877878:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:2.0:1787572424.877889:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2355:x1874405244315904:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572424.877903:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572424.877925:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 8 pid: 6693 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.877951:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 8 pid: 6693 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.877973:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f4368a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba61 expref: 8 pid: 6693 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.877989:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572424.877993:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572424.877999:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.878009:0:7642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.878044:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572424.878099:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244315904:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 212us (8217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572424.878116:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00010000:00010000:1.0:1787572424.878480:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.878500:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.878524:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.878538:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.878547:0:12010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.878553:0:12010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572424.878558:0:12010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.878579:0:12010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.878592:0:12010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.878599:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f4368bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572424.878687:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244315776:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 16366us (17003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572424.878696:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:2.0:1787572424.883592:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572424.883680:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244316160 00000100:00100000:3.0:1787572424.883691:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244316160 00000100:00100000:3.0:1787572424.883744:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:3.0:1787572424.883754:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+12:10449:x1874405244316160:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787572424.883831:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.883849:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.883860:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.884070:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.884081:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 13 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.884090:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.884125:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 13 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572424.884165:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 13 pid: 7555 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572424.884182:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268457600:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572424.884266:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d07e1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787572424.889871:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268457600:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572424.889900:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572424.892112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572424.892152:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244316288 00000100:00100000:0.0:1787572424.892162:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244316288 00010000:00010000:0.0:1787572424.892203:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 14 pid: 7555 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572424.892239:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:0.0:1787572424.892249:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:2353:x1874405244316288:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572424.892264:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572424.892271:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 14 pid: 7555 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.892285:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 14 pid: 7555 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.892306:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba4c expref: 14 pid: 7555 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.892342:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:0.0:1787572424.892347:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.892356:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.892362:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.892384:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572424.892435:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2353:x1874405244316288:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572424.892442:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00010000:00010000:0.0:1787572424.892615:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.892624:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787572424.892833:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787572424.893010:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787572424.893063:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787572424.893142:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1874405268457728:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787572424.893188:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572424.893213:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572424.894210:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268457728 00000100:00100000:2.0:1787572424.894220:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268457728 00000100:00100000:2.0:1787572424.894270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572424.894280:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1874405268457728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787572424.894377:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1874405268457728:12345-0@lo:1000:mdt00_002.0 Request processed in 99us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572424.894384:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787572424.894497:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1874405268457728:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787572424.895896:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787572424.895989:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1874405268457856:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787572424.896037:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572424.896493:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268457856 00000100:00100000:0.0:1787572424.896499:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96300 going to sleep for 11 seconds 00000100:00100000:1.0:1787572424.896502:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268457856 00000100:00100000:1.0:1787572424.896549:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572424.896558:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1874405268457856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787572424.898232:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1874405268457856:12345-0@lo:1000:mdt00_002.0 Request processed in 1670us (2190us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787572424.898244:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787572424.898340:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1874405268457856:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787572424.898385:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898396:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898403:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898409:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572424.898414:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898420:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898437:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:2.0:1787572424.898440:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787572424.898449:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898456:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f4368cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898489:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898494:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898499:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898504:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572424.898506:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898512:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898519:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:2.0:1787572424.898521:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787572424.898524:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898529:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f436800 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898545:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898558:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898594:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898625:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.898656:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 16 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572424.898668:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd37100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268457984:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572424.898732:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787572424.905066:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd37100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268457984:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572424.905097:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572424.905689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572424.905741:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244316416 00000100:00100000:2.0:1787572424.905748:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244316416 00010000:00010000:2.0:1787572424.905796:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 17 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572424.905836:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:2.0:1787572424.905847:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:2354:x1874405244316416:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572424.905873:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572424.905882:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 17 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.905912:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 17 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.905935:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43681c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba30 expref: 17 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.905949:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:2.0:1787572424.905954:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.905962:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.905969:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.905994:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572424.906042:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:2354:x1874405244316416:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 196us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572424.906049:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00010000:00010000:0.0:1787572424.906245:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906252:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906263:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906270:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906276:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906283:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572424.906287:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906295:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906305:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:0.0:1787572424.906308:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572424.906311:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906317:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f4368d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906348:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906354:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906359:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906365:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572424.906368:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906374:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906383:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:0.0:1787572424.906386:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787572424.906389:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572424.906395:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4368c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572424.906837:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10449:x1874405244316160:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 23083us (23253us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787572424.906848:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 83 00000020:00080000:0.0:1787572424.906863:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787572424.907026:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787572424.907032:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787572424.907061:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787572424.907067:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787572424.909461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572424.909587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244316672 00000100:00100000:2.0:1787572424.909597:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244316672 00000100:00100000:2.0:1787572424.909666:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:2.0:1787572424.909677:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10449:x1874405244316672:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787572424.910580:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787572424.910913:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787572424.910961:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.910978:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.910995:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.911004:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.911010:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.911017:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572424.911045:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787572424.911135:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:10449:x1874405244316672:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1459us (1678us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787572424.911145:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000020:00080000:1.0:1787572424.911150:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787572424.911276:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572424.911282:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.911290:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572424.911294:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.911302:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.911313:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:2.0:1787572424.911317:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787572424.911335:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.911341:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572424.911356:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572424.911358:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572424.911360:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572425.199091:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268458240:0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.199164:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572425.199232:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268458752:0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.199262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572425.199293:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787572425.199299:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268458112:0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.199338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572425.199359:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268458624:0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.199395:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572425.199425:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268458752 00000100:00100000:1.0:1787572425.199431:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268458752 00000100:00100000:1.0:1787572425.199474:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787572425.199484:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f41e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268458752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.199535:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f41e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268458752:12345-0@lo:400:kworker.0 Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572425.199542:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787572425.199730:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268458112 00000100:00100000:1.0:1787572425.199734:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268458112 00000100:00100000:1.0:1787572425.199881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787572425.199890:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268458112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.199935:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268458112:12345-0@lo:400:kworker.0 Request processed in 47us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572425.199941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787572425.199964:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268458240 00000100:00100000:1.0:1787572425.199967:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268458240 00000100:00100000:1.0:1787572425.199991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268458624 00000100:00100000:1.0:1787572425.199994:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268458624 00000100:00100000:1.0:1787572425.200017:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787572425.200025:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268458240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.200056:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268458240:12345-0@lo:400:kworker.0 Request processed in 32us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572425.200062:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787572425.200073:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787572425.200078:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268458624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.200101:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268458624:12345-0@lo:400:kworker.0 Request processed in 24us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572425.200107:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1787572425.200127:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572425.200151:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268458112:0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.200165:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268458624:0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.200173:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268458240:0@lo:400:kworker.0 00000100:00100000:1.0:1787572425.200182:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268458752:0@lo:400:kworker.0 00000100:00100000:2.0:1787572425.200302:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268458368:0@lo:400:kworker.0 00000100:00100000:2.0:1787572425.200342:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572425.200365:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787572425.200370:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268458496:0@lo:400:kworker.0 00000100:00100000:2.0:1787572425.200389:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572425.200452:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268458496 00000100:00100000:3.0:1787572425.200457:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268458496 00000100:00100000:3.0:1787572425.200497:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787572425.200506:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874405268458496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572425.200546:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874405268458496:12345-0@lo:400:kworker.0 Request processed in 43us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572425.200551:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787572425.201179:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572425.201212:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268458496:0@lo:400:kworker.0 00000100:00100000:0.0:1787572425.201345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268458368 00000100:00100000:0.0:1787572425.201351:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268458368 00000100:00100000:0.0:1787572425.201416:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787572425.201424:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268458368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572425.201470:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268458368:12345-0@lo:400:kworker.0 Request processed in 47us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572425.201476:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1787572425.202979:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572425.203023:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268458368:0@lo:400:kworker.0 00010000:00010000:1.0:1787572425.520192:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572425.713501:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268458880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572425.713581:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572425.713927:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268458880 00000100:00100000:3.0:1787572425.713937:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268458880 00000100:00100000:3.0:1787572425.713983:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787572425.713994:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874405268458880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572425.714018:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787572425.714120:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874405268458880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572425.714403:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268458880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572425.714479:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787572426.047663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572426.047706:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572426.047738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572426.047761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572426.047791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572426.047819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244317312 00000100:00100000:1.0:1787572426.047827:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244317056 00000100:00100000:0.0:1787572426.047830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244317312 00000100:00100000:1.0:1787572426.047834:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244317056 00000100:00100000:0.0:1787572426.047898:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244316928 00000100:00100000:1.0:1787572426.047899:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244317184 00000100:00100000:0.0:1787572426.047903:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244316928 00000100:00100000:1.0:1787572426.047905:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244317184 00000100:00100000:0.0:1787572426.047937:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 142 00000100:00100000:1.0:1787572426.047942:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:0.0:1787572426.047951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244317312:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572426.048027:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244317312:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572426.048035:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 142 00000100:00100000:0.0:1787572426.048050:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 143 00000100:00100000:0.0:1787572426.048056:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:2354:x1874405244316928:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572426.048083:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:2354:x1874405244316928:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572426.048095:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 143 00000100:00100000:0.0:1787572426.048225:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:0.0:1787572426.048233:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244317184:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572426.048267:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244317184:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 36us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572426.048274:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:1.0:1787572426.048696:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244317056:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572426.048734:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244317056:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 784us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572426.048742:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:2.0:1787572426.048888:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244316800 00000100:00100000:2.0:1787572426.048901:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244316800 00000100:00100000:2.0:1787572426.048943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 289 00000100:00100000:2.0:1787572426.048953:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244316800:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572426.048998:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244316800:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 46us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572426.049004:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 289 00000100:00080000:2.0:1787572426.049034:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787572426.049038:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572426.049041:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572426.259582:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268459008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572426.259671:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572426.270704:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268459008 00000100:00100000:2.0:1787572426.270719:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268459008 00000100:00100000:2.0:1787572426.270778:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787572426.270789:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874405268459008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572426.270826:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572426.270911:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874405268459008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (11240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572426.270918:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787572426.272541:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268459008:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787572426.338245:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1787572426.338264:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1787572426.543240:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787572426.972198:0:12066:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787572426.972208:0:12066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572426.972245:0:12066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787572426.972252:0:12066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787572427.251339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572427.251393:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244317568 00000100:00100000:3.0:1787572427.251404:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244317568 00000100:00100000:3.0:1787572427.251459:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:3.0:1787572427.251468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:10468:x1874405244317568:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572427.251489:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572427.251508:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4368e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba68 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.255602:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4368e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.255626:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4368e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.258603:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4368e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572427.259435:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787572427.259775:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4368e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba68 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.259796:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4368e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba68 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.259805:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572427.259813:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787572427.259817:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eaa00, rc 0) 00000100:00100000:3.0:1787572427.259888:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10468:x1874405244317568:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 8420us (8557us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787572427.259898:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:3.0:1787572427.267233:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572427.267331:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244317696 00000100:00100000:1.0:1787572427.267341:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244317696 00000100:00100000:1.0:1787572427.267410:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:1.0:1787572427.267422:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10468:x1874405244317696:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:1.0:1787572427.267510:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267529:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267541:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267557:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267564:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267583:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267917:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267926:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267934:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572427.267976:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267990:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.267996:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268003:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268009:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572427.268014:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268022:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268035:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572427.268043:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572427.268049:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268055:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f4368f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268067:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268072:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268078:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268083:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572427.268086:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268092:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268100:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572427.268103:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572427.268105:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268111:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f4368fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268124:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268136:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268141:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268147:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572427.268150:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268156:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268164:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572427.268166:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572427.268169:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.268175:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572427.268256:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10468:x1874405244317696:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 835us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572427.268264:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:3.0:1787572427.373134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572427.373237:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244317952 00000100:00100000:2.0:1787572427.373247:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244317952 00000100:00100000:2.0:1787572427.373316:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:2.0:1787572427.373328:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10471:x1874405244317952:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572427.373366:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572427.373389:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43690a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba6f expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.373470:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.373490:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.373738:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.373756:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.373764:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.373770:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.374406:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.374417:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.374424:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572427.374434:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787572427.376949:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.376966:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.376973:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.376980:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572427.376984:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.376990:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377005:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:2.0:1787572427.377008:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572427.377012:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377018:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436911 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377035:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377041:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377047:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377053:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572427.377071:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377077:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377086:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c3a46a00) 00010000:00010000:2.0:1787572427.377088:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572427.377091:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377098:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377156:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43690a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 22 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377173:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 21 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.377180:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:2.0:1787572427.377183:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572427.377185:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276a00, rc 0) 00000100:00100000:2.0:1787572427.379848:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10471:x1874405244317952:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 6511us (6713us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787572427.379862:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:3.0:1787572427.387867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572427.387957:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244318080 00000100:00100000:1.0:1787572427.387968:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244318080 00000100:00100000:1.0:1787572427.388046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:1.0:1787572427.388056:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10471:x1874405244318080:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1787572427.388126:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388157:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388169:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388198:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388205:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388212:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388218:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572427.388222:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388229:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388242:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:1.0:1787572427.388244:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572427.388249:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.388255:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43692d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572427.388348:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10471:x1874405244318080:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 292us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572427.388362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:3.0:1787572427.392695:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572427.393248:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244318336 00000100:00100000:0.0:1787572427.393259:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244318336 00000100:00100000:0.0:1787572427.393326:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:0.0:1787572427.393336:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7481850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10471:x1874405244318336:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572427.393571:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7481850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:10471:x1874405244318336:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 235us (886us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787572427.393580:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1787572427.470826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572427.471287:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244318592 00000100:00100000:3.0:1787572427.471299:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244318592 00000100:00100000:3.0:1787572427.471376:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 88 00000100:00100000:3.0:1787572427.471393:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:9991:x1874405244318592:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1787572427.471423:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572427.471446:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436934 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba76 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.471555:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.471570:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 23 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.471581:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.471618:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 23 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.471688:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 23 pid: 7555 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572427.471857:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268459136:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572427.472235:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d07e1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572427.478404:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268459136:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572427.478436:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572427.495512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572427.496286:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244318720 00000100:00100000:0.0:1787572427.496297:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244318720 00010000:00010000:0.0:1787572427.496339:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 24 pid: 7555 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572427.496405:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1787572427.496416:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:2353:x1874405244318720:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572427.496431:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572427.496471:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 24 pid: 7555 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.496485:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 24 pid: 7555 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.496508:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43691f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba6f expref: 24 pid: 7555 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.496533:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:0.0:1787572427.496539:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.496547:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.496571:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.496608:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572427.496730:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:2353:x1874405244318720:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 315us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572427.496738:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00010000:00010000:1.0:1787572427.498133:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.498145:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572427.498166:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787572427.498364:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436934 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.498391:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.498400:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:1.0:1787572427.498403:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787572427.498406:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea200, rc 0) 00000100:00100000:1.0:1787572427.498485:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:9991:x1874405244318592:12345-192.168.204.55@tcp:101:bash.0 Request processed in 27088us (27661us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787572427.498493:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 88 00000100:00100000:2.0:1787572427.510350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572427.511036:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244318976 00000100:00100000:1.0:1787572427.511046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244318976 00000100:00100000:1.0:1787572427.511113:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 89 00000100:00100000:1.0:1787572427.511123:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:9991:x1874405244318976:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:1.0:1787572427.511386:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.511403:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.511425:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572427.511475:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787572427.511498:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c98e2d0 reply state 0000000069680d93 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572427.511507:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787572427.511549:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787572427.511962:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:9991:x1874405244318976:12345-192.168.204.55@tcp:36:bash.0 Request processed in 511us (1293us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787572427.511969:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 89 00000020:00080000:1.0:1787572427.511974:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787572427.515502:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.515518:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.515526:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.515532:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572427.515536:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.515544:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.515560:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:1.0:1787572427.515563:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572427.515583:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.515589:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436949 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572427.517209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572427.517951:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244319104 00000100:00100000:3.0:1787572427.517961:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244319104 00000100:00100000:3.0:1787572427.518023:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:3.0:1787572427.518033:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:9991:x1874405244319104:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1787572427.518058:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572427.518078:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436950 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba7d expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.518137:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436950 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba7d expref: 27 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.518151:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436950 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba7d expref: 27 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.518170:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:3.0:1787572427.518173:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572427.518176:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ebc00, rc 0) 00000100:00100000:3.0:1787572427.518231:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:9991:x1874405244319104:12345-192.168.204.55@tcp:101:bash.0 Request processed in 199us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572427.518238:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:0.0:1787572427.524301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572427.524781:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244319232 00000100:00100000:2.0:1787572427.524790:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244319232 00000100:00100000:2.0:1787572427.524835:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:2.0:1787572427.524844:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:9991:x1874405244319232:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572427.524861:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572427.524881:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba84 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572427.524906:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c30c5, atime: 0x6a8c30c3, ctime: 0x6a8c30c5, blocks: 0xb 00010000:00010000:2.0:1787572427.524937:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1787572427.524942:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572427.524950:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.524968:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.524980:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276400, rc 0) 00000100:00100000:2.0:1787572427.525031:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:9991:x1874405244319232:12345-192.168.204.55@tcp:101:bash.0 Request processed in 187us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572427.525039:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:2.0:1787572427.531858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572427.532291:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244319360 00000100:00100000:1.0:1787572427.532301:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244319360 00002000:00010000:1.0:1787572427.532341:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787572427.532346:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1fc8d1180 with x1874405244319360 ext(0->18446744073709551615) 00002000:00010000:1.0:1787572427.532357:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1fc8d1180. 00000100:00100000:1.0:1787572427.532391:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:1.0:1787572427.532402:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244319360:12345-192.168.204.55@tcp:10:bash.0 00002000:00010000:1.0:1787572427.532692:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787572427.533036:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787572421 -> 1787572425 00002000:00010000:1.0:1787572427.533039:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787572419 -> 1787572419 00002000:00010000:1.0:1787572427.533042:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787572421 -> 1787572425 00002000:00010000:1.0:1787572427.533044:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787572427.535853:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244319360:12345-192.168.204.55@tcp:10:bash.0 Request processed in 3444us (3995us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787572427.535872:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00002000:00010000:0.0:1787572427.535878:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787572427.535883:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1fc8d1180 with x1874405244319360 ext(0->18446744073709551615) 00002000:00010000:0.0:1787572427.535907:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1fc8d1180. 00010000:00010000:1.0:1787572427.567372:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572427.635540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572427.635946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244319488 00000100:00100000:3.0:1787572427.635956:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244319488 00000100:00100000:3.0:1787572427.636017:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:3.0:1787572427.636028:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:10485:x1874405244319488:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:3.0:1787572427.636116:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636133:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636150:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636164:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636318:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636325:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636610:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636620:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636627:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787572427.636908:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636927:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636935:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636942:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636949:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572427.636953:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636960:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636971:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572427.636974:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572427.636979:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636985:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43695e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.636997:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637003:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637008:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637018:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572427.637021:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637026:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637104:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c577c500) 00010000:00010000:3.0:1787572427.637107:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572427.637110:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637116:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637192:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637199:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637204:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637209:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eac00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572427.637211:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637217:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637233:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:3.0:1787572427.637235:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572427.637238:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.637243:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f43696c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572427.637335:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:10485:x1874405244319488:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 1308us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572427.637343:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:3.0:1787572427.705803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572427.706174:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244319744 00000100:00100000:2.0:1787572427.706184:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244319744 00000100:00100000:2.0:1787572427.706250:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 92 00000100:00100000:2.0:1787572427.706260:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:10488:x1874405244319744:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572427.706304:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572427.706324:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436973 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba8b expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.706401:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.706416:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.706428:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.706442:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.706450:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.706457:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707203:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707216:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707224:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572427.707235:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787572427.707341:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707350:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707358:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707365:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572427.707369:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707378:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707390:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:2.0:1787572427.707393:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572427.707397:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707404:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43697a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707417:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707424:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707431:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707436:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572427.707445:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707452:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707459:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c3a46700) 00010000:00010000:2.0:1787572427.707462:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572427.707465:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707472:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436981 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707512:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436973 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba8b expref: 30 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707527:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba8b expref: 29 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.707536:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:2.0:1787572427.707538:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787572427.707541:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276800, rc 0) 00000100:00100000:2.0:1787572427.707711:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:10488:x1874405244319744:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1453us (1917us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787572427.707854:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 92 00000100:00100000:2.0:1787572427.714190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572427.714292:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244319872 00000100:00100000:1.0:1787572427.714302:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244319872 00000100:00100000:1.0:1787572427.714359:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:1.0:1787572427.714371:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:10488:x1874405244319872:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1787572427.714439:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.714455:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.714482:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.714519:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.714533:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 29 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572427.714547:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268459264:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572427.714661:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86780 going to sleep for 11 seconds 00000100:00100000:1.0:1787572427.717615:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd17800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268459264:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572427.717669:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572427.724256:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572427.724522:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244320128 00000100:00100000:0.0:1787572427.724532:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244320128 00000100:00100000:0.0:1787572427.724592:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:0.0:1787572427.724602:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:5594:x1874405244320128:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787572427.724963:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:5594:x1874405244320128:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 361us (717us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787572427.724972:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:0.0:1787572427.727295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572427.727373:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244320256 00000100:00100000:3.0:1787572427.727383:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244320256 00010000:00010000:3.0:1787572427.727419:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 31 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572427.727459:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1787572427.727470:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:2355:x1874405244320256:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572427.727483:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572427.727490:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 31 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.727505:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 31 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.727526:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43693b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba76 expref: 31 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.727557:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:3.0:1787572427.727562:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.727580:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.727589:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.727620:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572427.727707:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:2355:x1874405244320256:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 238us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572427.727724:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00010000:00010000:1.0:1787572427.727866:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.727874:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.727900:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.727906:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.727913:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.727925:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572427.727930:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.727938:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.727947:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:1.0:1787572427.727951:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572427.727954:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572427.727960:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572427.728022:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:10488:x1874405244319872:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 13653us (13841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572427.728038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:0.0:1787572427.731876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572427.731956:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244320512 00000100:00100000:3.0:1787572427.731965:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244320512 00000100:00100000:3.0:1787572427.732028:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:3.0:1787572427.732138:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:10488:x1874405244320512:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1787572427.732517:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:10488:x1874405244320512:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 382us (648us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787572427.741385:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:3.0:1787572427.901827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572427.901997:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244320768 00000100:00100000:0.0:1787572427.902006:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244320768 00000100:00100000:0.0:1787572427.902070:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:0.0:1787572427.902080:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:10499:x1874405244320768:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:0.0:1787572427.902103:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572427.902123:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f43699d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902195:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902211:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902221:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902235:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902255:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902272:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902571:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4369b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902582:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4369b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902589:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4369b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572427.902599:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787572427.902716:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902724:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902731:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902738:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572427.902742:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902749:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902771:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:0.0:1787572427.902774:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572427.902779:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902785:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902798:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902804:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902809:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902814:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572427.902816:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902821:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902827:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1e1353d00) 00010000:00010000:0.0:1787572427.902829:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572427.902832:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902838:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902889:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f43699d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba92 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902901:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4369b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba92 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.902907:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:0.0:1787572427.902909:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572427.902911:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670400, rc 0) 00000100:00100000:0.0:1787572427.902980:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10499:x1874405244320768:12345-192.168.204.55@tcp:101:cat.0 Request processed in 902us (1175us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787572427.902987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:2.0:1787572427.907738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572427.907820:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244321024 00000100:00100000:1.0:1787572427.907829:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244321024 00000100:00100000:1.0:1787572427.907888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:1.0:1787572427.907898:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10499:x1874405244321024:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:1.0:1787572427.908260:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10499:x1874405244321024:12345-192.168.204.55@tcp:35:cat.0 Request processed in 363us (531us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787572427.908278:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:1.0:1787572427.961347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572427.961501:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244321280 00000100:00100000:3.0:1787572427.961512:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244321280 00000100:00100000:3.0:1787572427.961569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:3.0:1787572427.961579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10500:x1874405244321280:12345-192.168.204.55@tcp:36:rm.0 00010000:00010000:3.0:1787572427.961688:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787572427.961725:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4369b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba92 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.961748:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba8b expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.961762:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436950 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba7d expref: 31 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.961772:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c3a46b00) 00010000:00010000:3.0:1787572427.961783:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572427.961803:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.961815:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.961823:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.961836:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.961844:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.961850:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962151:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962160:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962166:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787572427.962788:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1787572427.962798:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358059162145ns, next at 359059159825ns, rc = 0 00010000:00010000:3.0:1787572427.962851:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962861:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962869:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962877:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962883:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962890:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962914:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572427.962932:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962944:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962951:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962958:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eac00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572427.962962:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962969:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962979:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577c700) 00010000:00010000:3.0:1787572427.962982:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787572427.962985:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.962990:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4369ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.963005:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.963010:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.963017:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.963022:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572427.963030:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.963047:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.963054:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572427.963056:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572427.963059:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572427.963064:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4369c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787572427.963074:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da6c3391 reply state 0000000089135e09 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572427.963082:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787572427.963158:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:10500:x1874405244321280:12345-192.168.204.55@tcp:36:rm.0 Request processed in 1578us (1819us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787572427.963166:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 95 00010000:00010000:2.0:1787572427.963740:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572427.963754:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.963762:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572427.963766:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.963773:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.963783:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d1c577c700) 00010000:00010000:2.0:1787572427.963785:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787572427.963788:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.963794:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4369d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572427.963810:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572427.963812:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572427.963813:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572427.966033:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.966049:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.966057:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.966062:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572427.966066:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.966073:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.966087:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c577c500) 00010000:00010000:0.0:1787572427.966100:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572427.966104:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572427.966111:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f4369c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572428.047445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.047716:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244321536 00000100:00100000:0.0:1787572428.047726:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244321536 00000100:00100000:0.0:1787572428.047800:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 96 00000100:00100000:0.0:1787572428.047812:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:10506:x1874405244321536:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572428.047839:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572428.047859:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4369dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dba99 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.047985:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.047999:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.048010:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.048022:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.048029:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.048036:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787572428.049350:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787572428.049519:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050297:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050318:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787572428.050422:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787572428.050491:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050504:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050515:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050526:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572428.050533:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050545:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050563:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:0.0:1787572428.050568:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572428.050575:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050608:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4369e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787572428.050924:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b266ed2 reply state 00000000f6c99b76 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572428.050937:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787572428.050975:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4369dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050990:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.050997:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1e1353400) 00010000:00010000:0.0:1787572428.051000:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572428.051002:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671200, rc 0) 00000100:00100000:0.0:1787572428.054280:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10506:x1874405244321536:12345-192.168.204.55@tcp:101:bash.0 Request processed in 6450us (6825us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787572428.054293:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 96 00010000:00010000:1.0:1787572428.069185:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.069217:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.069226:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.069233:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572428.069239:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.069248:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.069277:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1e1353d00) 00010000:00010000:1.0:1787572428.069281:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572428.069285:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.069302:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670000/0x9fe530ef4f4369ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572428.087831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.087987:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244321664 00000100:00100000:0.0:1787572428.087997:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244321664 00000100:00100000:0.0:1787572428.088067:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:0.0:1787572428.088078:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2355:x1874405244321664:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572428.088095:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572428.088115:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbaa0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787572428.088160:0:12010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572428.088177:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1787572428.088182:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572428.088191:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 6 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.088210:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 6 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.088224:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670800, rc 0) 00000100:00100000:0.0:1787572428.088290:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244321664:12345-192.168.204.55@tcp:101:bash.0 Request processed in 214us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572428.088297:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00080000:2.0:1787572428.090157:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787572428.108069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572428.108315:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244321792 00000100:00100000:2.0:1787572428.108324:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244321792 00000100:00100000:2.0:1787572428.108390:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:2.0:1787572428.108400:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:10506:x1874405244321792:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572428.108419:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572428.108438:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbaa7 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.108492:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.108501:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572428.108506:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572428.108510:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.108547:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.108560:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 7 pid: 12010 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572428.108574:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874405268459392:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572428.108723:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787572428.110862:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874405268459392:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572428.110896:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.110915:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276600, rc 0) 00000100:00100000:2.0:1787572428.110984:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:10506:x1874405244321792:12345-192.168.204.55@tcp:101:bash.0 Request processed in 2584us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572428.110993:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:3.0:1787572428.113668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.113788:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244321920 00000100:00100000:0.0:1787572428.113798:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244321920 00010000:00010000:0.0:1787572428.113840:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 7 pid: 12010 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572428.113881:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:0.0:1787572428.113891:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244321920:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572428.113906:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572428.113928:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 7 pid: 12010 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.113970:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 7 pid: 12010 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.113992:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4369ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa0 expref: 7 pid: 12010 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.114007:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572428.114011:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572428.114020:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.114031:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.114067:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572428.114082:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1874405268459520:192.168.204.55@tcp:105: 00000100:00100000:0.0:1787572428.114160:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787572428.122068:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1874405268459520:192.168.204.55@tcp:105: 00010000:00010000:0.0:1787572428.122105:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572428.122175:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244321920:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 8284us (8514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572428.122186:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:1.0:1787572428.129592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572428.129698:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244322176 00000100:00100000:2.0:1787572428.129716:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244322176 00000100:00100000:2.0:1787572428.129781:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:2.0:1787572428.129793:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:10506:x1874405244322176:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:2.0:1787572428.130436:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10506:x1874405244322176:12345-192.168.204.55@tcp:35:bash.0 Request processed in 643us (852us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787572428.130445:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:3.0:1787572428.458691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.462647:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244322304 00000100:00100000:0.0:1787572428.462662:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244322304 00000100:00100000:0.0:1787572428.462742:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:0.0:1787572428.462753:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:10522:x1874405244322304:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572428.462777:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572428.462798:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbaae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.462860:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.462873:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.462884:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572428.462940:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787572428.462944:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572428.462965:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.462989:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaae expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.463007:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaae expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.463015:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:0.0:1787572428.463018:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572428.463034:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670600, rc 0) 00000100:00100000:0.0:1787572428.463112:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:10522:x1874405244322304:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 361us (4442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572428.463120:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:3.0:1787572428.468557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572428.468666:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244322560 00000100:00100000:2.0:1787572428.468676:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244322560 00000100:00100000:2.0:1787572428.468892:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 98 00000100:00100000:2.0:1787572428.468902:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:10522:x1874405244322560:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572428.468923:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572428.468951:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436a1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbab5 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.469049:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436a22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.469062:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.469073:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572428.469083:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787572428.469304:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436a1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbab5 expref: 38 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.469322:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436a22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbab5 expref: 37 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.469343:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1e1353400) 00010000:00010000:2.0:1787572428.469346:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572428.469350:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276a00, rc 0) 00000100:00100000:2.0:1787572428.469794:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+37:10522:x1874405244322560:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 892us (1243us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787572428.469803:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 98 00000100:00100000:3.0:1787572428.481689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.483577:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244322816 00000100:00100000:0.0:1787572428.483589:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244322816 00000100:00100000:2.0:1787572428.483688:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:2.0:1787572428.483702:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+37:2354:x1874405244322816:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572428.483718:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572428.483743:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436a22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbab5 expref: 37 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.483763:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1e1353400) 00010000:00010000:2.0:1787572428.483768:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572428.483839:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:2354:x1874405244322816:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 142us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572428.483847:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1787572428.492813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.492970:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244322944 00000100:00100000:0.0:1787572428.492980:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244322944 00000100:00100000:0.0:1787572428.493047:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:0.0:1787572428.493058:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:10522:x1874405244322944:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572428.493087:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572428.493109:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436a30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbabc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.493284:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436a37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.493298:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.493310:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572428.493328:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787572428.493456:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436a30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbabc expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.493475:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbabc expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.493562:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1e1353400) 00010000:00010000:0.0:1787572428.493565:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787572428.493569:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670a00, rc 0) 00000100:00100000:0.0:1787572428.494842:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:10522:x1874405244322944:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1783us (2036us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787572428.494851:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:3.0:1787572428.507421:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.508055:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244323072 00000100:00100000:0.0:1787572428.508065:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244323072 00000100:00100000:0.0:1787572428.508121:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:0.0:1787572428.508130:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244323072:12345-192.168.204.55@tcp:1:lfs.0 00010000:00010000:0.0:1787572428.508175:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.508194:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.508202:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572428.508206:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787572428.508211:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.508242:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.508290:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 6 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572428.508317:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1874405268459648:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572428.508404:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a969c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572428.517942:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1874405268459648:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572428.517982:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572428.530234:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572428.530450:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244323200 00000100:00100000:2.0:1787572428.530460:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244323200 00002000:00100000:2.0:1787572428.530508:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98d1ef3ed180 x1874405244323200/t0(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:464/0 lens 504/0 e 0 to 0 dl 1787572439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572428.530520:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1ef3ed180 with x1874405244323200 ext(0->8) 00010000:00010000:2.0:1787572428.530528:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 7 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.530571:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 7 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572428.530583:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d1ef3ed180 00000100:00100000:2.0:1787572428.530610:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:2.0:1787572428.530621:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244323200:12345-192.168.204.55@tcp:4:lfs.0 00000100:00100000:2.0:1787572428.531383:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2354:x1874405244323200:12345-192.168.204.55@tcp:4:lfs.0 Request processed in 761us (1156us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787572428.531391:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00002000:00100000:2.0:1787572428.531399:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98d1ef3ed180 x1874405244323200/t4294967302(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:464/0 lens 504/448 e 0 to 0 dl 1787572439 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572428.531408:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1ef3ed180 with x1874405244323200 ext(0->8) 00010000:00010000:2.0:1787572428.531415:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.531428:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572428.531435:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d1ef3ed180 00000100:00100000:2.0:1787572428.543063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572428.543167:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244323328 00000100:00100000:3.0:1787572428.543192:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244323328 00010000:00010000:3.0:1787572428.543234:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572428.543294:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:3.0:1787572428.543305:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2355:x1874405244323328:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572428.543321:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787572428.543343:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787572428.543346:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787572426 00002000:00010000:3.0:1787572428.543348:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787572426 00002000:00010000:3.0:1787572428.543350:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787572426 00010000:00010000:3.0:1787572428.543356:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.543371:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.543397:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f436a06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaa7 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.543414:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572428.543418:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572428.543424:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.543433:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.543480:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572428.543535:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2355:x1874405244323328:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 232us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572428.543543:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00010000:00010000:1.0:1787572428.543618:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.543685:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.543731:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.543739:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.543747:0:12010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.543755:0:12010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572428.543760:0:12010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.543769:0:12010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.543782:0:12010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.543789:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436a45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572428.543835:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2356:x1874405244323072:12345-192.168.204.55@tcp:1:lfs.0 Request processed in 35705us (36421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572428.543843:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:0.0:1787572428.547416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572428.547485:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244323584 00000100:00100000:1.0:1787572428.547506:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244323584 00000100:00100000:1.0:1787572428.547562:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:1.0:1787572428.547572:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7480850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:10522:x1874405244323584:12345-192.168.204.55@tcp:35:lfs.0 00000004:00010000:1.0:1787572428.547665:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbabc expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572428.547949:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787572428.548004:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787572428.548337:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787572428.548392:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.548407:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.548415:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.548451:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.548466:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 42 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572428.548480:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1874405268459776:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572428.548564:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86780 going to sleep for 11 seconds 00000100:00100000:1.0:1787572428.554134:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1874405268459776:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572428.554183:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572428.556579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572428.557202:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244323712 00000100:00100000:3.0:1787572428.557213:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244323712 00010000:00010000:3.0:1787572428.557267:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 43 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572428.557309:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:3.0:1787572428.557319:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+43:2353:x1874405244323712:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572428.557333:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572428.557339:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 43 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.557353:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 43 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.557373:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f4369f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba99 expref: 43 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.557388:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1e1353400) 00010000:00010000:3.0:1787572428.557393:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.557401:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.557419:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.557449:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572428.557514:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+42:2353:x1874405244323712:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 196us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572428.557521:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00010000:00010000:1.0:1787572428.560879:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.560898:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572428.561053:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787572428.561276:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787572428.561415:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874405268459904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787572428.561476:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572428.561525:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86600 going to sleep for 11 seconds 00000100:00100000:0.0:1787572428.565724:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268459904 00000100:00100000:0.0:1787572428.565739:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268459904 00000100:00100000:0.0:1787572428.565815:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787572428.565825:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874405268459904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787572428.565970:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874405268459904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 146us (4493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572428.565978:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787572428.566185:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787572428.566191:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787572428.566215:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d1f42fd500, transno 4294967301 00000100:00100000:3.0:1787572428.566227:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874405268459904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787572428.566716:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787572428.566790:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874405268460032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787572428.566829:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572428.566851:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1eb553000 going to sleep for 11 seconds 00000100:00080000:2.0:1787572428.567605:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572428.567976:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268460032 00000100:00100000:0.0:1787572428.567983:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268460032 00000100:00100000:0.0:1787572428.568017:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787572428.568026:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874405268460032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787572428.568199:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1874405268460032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 173us (1368us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787572428.568206:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572428.568754:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874405268460032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787572428.568819:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787572428.568866:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.568876:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.568884:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.568891:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572428.568906:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.568913:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.568929:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1e1353400) 00010000:00010000:3.0:1787572428.569179:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787572428.569185:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572428.569192:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787572428.569381:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787572428.569460:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787572428.569470:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358665834529ns, next at 359665832665ns, rc = 0 00000001:00080000:3.0:1787572428.569475:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787572428.569507:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1e1353400) 00010000:00010000:3.0:1787572428.569510:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787572428.569517:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436a37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbabc expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572428.569710:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7480850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+45:10522:x1874405244323584:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 22138us (22300us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787572428.569720:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000020:00080000:3.0:1787572428.569725:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787572428.576454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572428.578994:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244323840 00000100:00100000:1.0:1787572428.579009:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244323840 00000100:00100000:1.0:1787572428.579079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:1.0:1787572428.579088:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+45:10522:x1874405244323840:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572428.579113:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572428.579135:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbac3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.579195:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbac3 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.579210:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbac3 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.579228:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572428.579245:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787572428.579260:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462200, rc 0) 00000100:00100000:1.0:1787572428.579315:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+46:10522:x1874405244323840:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 228us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572428.579321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 100 00010000:00010000:1.0:1787572428.592090:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572428.600462:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.600552:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244324096 00000100:00100000:0.0:1787572428.600575:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244324096 00000100:00100000:0.0:1787572428.600631:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:0.0:1787572428.600674:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+46:10522:x1874405244324096:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572428.600910:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+47:10522:x1874405244324096:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 239us (458us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787572428.600920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:0.0:1787572428.750083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572428.752111:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244324224 00000100:00100000:1.0:1787572428.752125:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244324224 00000100:00100000:1.0:1787572428.752192:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:1.0:1787572428.752202:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+47:10532:x1874405244324224:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:1.0:1787572428.752286:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752302:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752313:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752328:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752335:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752341:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752434:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752459:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752467:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572428.752505:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752517:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752523:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752530:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752536:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572428.752540:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752547:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752558:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572428.752561:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572428.752566:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752572:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752590:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752597:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752602:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752607:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572428.752610:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752616:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752623:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572428.752626:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572428.752629:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752914:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752931:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752937:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752943:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752963:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572428.752966:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752973:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752982:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572428.752985:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572428.752987:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572428.752993:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436a68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572428.753085:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+47:10532:x1874405244324224:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 883us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572428.753093:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:1.0:1787572428.812050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.812194:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244324480 00000100:00100000:0.0:1787572428.812206:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244324480 00000100:00100000:0.0:1787572428.812277:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 102 00000100:00100000:0.0:1787572428.812288:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+47:10535:x1874405244324480:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572428.812309:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572428.812329:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbaca expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812403:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812417:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812426:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812440:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812445:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812467:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812595:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812603:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812610:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572428.812618:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787572428.812757:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812765:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812771:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812777:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572428.812782:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812790:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812801:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:0.0:1787572428.812804:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572428.812816:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812821:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436a76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812835:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812840:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812846:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812851:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572428.812854:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812859:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812867:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1e1353900) 00010000:00010000:0.0:1787572428.812869:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572428.812872:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812878:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436a7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812915:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaca expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812941:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaca expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.812948:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:0.0:1787572428.812950:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572428.812953:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670200, rc 0) 00000100:00100000:0.0:1787572428.813015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+49:10535:x1874405244324480:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 729us (976us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787572428.813022:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 102 00000100:00100000:2.0:1787572428.820128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.820279:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244324608 00000100:00100000:0.0:1787572428.820290:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244324608 00000100:00100000:0.0:1787572428.820351:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 103 00000100:00100000:0.0:1787572428.820363:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+49:10535:x1874405244324608:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:0.0:1787572428.820432:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820447:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820459:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820485:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820492:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820515:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820522:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572428.820526:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820534:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820546:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:0.0:1787572428.820549:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572428.820554:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.820560:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572428.820675:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+49:10535:x1874405244324608:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 315us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572428.820683:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 103 00000100:00100000:3.0:1787572428.823941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.824141:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244324864 00000100:00100000:0.0:1787572428.824150:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244324864 00000100:00100000:0.0:1787572428.824204:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:0.0:1787572428.824214:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+49:10535:x1874405244324864:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572428.824446:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+50:10535:x1874405244324864:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 233us (511us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787572428.824453:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:2.0:1787572428.952128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.952312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244325120 00000100:00100000:0.0:1787572428.952322:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244325120 00000100:00100000:0.0:1787572428.952385:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:0.0:1787572428.952396:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+50:10545:x1874405244325120:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572428.952422:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572428.952425:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787572428.952454:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaae expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.952474:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:0.0:1787572428.952479:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572428.952492:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbad1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.952585:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.952598:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.952608:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572428.952618:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787572428.952900:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436a99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad1 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.952914:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad1 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.952933:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:0.0:1787572428.952936:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572428.952938:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671e00, rc 0) 00000100:00100000:0.0:1787572428.953043:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+51:10545:x1874405244325120:12345-192.168.204.55@tcp:101:bash.0 Request processed in 648us (923us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787572428.953050:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:2.0:1787572428.968507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.968579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244325376 00000100:00100000:0.0:1787572428.968588:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244325376 00000100:00100000:0.0:1787572428.968683:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00100000:0.0:1787572428.968702:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+51:10545:x1874405244325376:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:0.0:1787572428.968759:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787572428.968784:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad1 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.968804:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaca expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.968813:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:0.0:1787572428.968817:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572428.969036:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.969049:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.969058:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787572428.969120:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787572428.969144:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9332537 reply state 0000000035ba9a20 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572428.969153:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787572428.969229:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+52:10545:x1874405244325376:12345-192.168.204.55@tcp:36:bash.0 Request processed in 537us (731us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787572428.969237:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 105 00000020:00080000:0.0:1787572428.969252:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787572428.974555:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.974572:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.974580:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.974585:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572428.974590:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.974597:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.974615:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:0.0:1787572428.974617:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572428.974623:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.974629:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436aae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572428.982363:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.982725:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244325504 00000100:00100000:0.0:1787572428.982735:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244325504 00000100:00100000:0.0:1787572428.982790:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:0.0:1787572428.982800:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+51:10545:x1874405244325504:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572428.982824:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572428.982844:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ab5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbad8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.982941:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.982972:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572428.982983:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572428.983017:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787572428.983021:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572428.983607:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.983661:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.983679:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572428.983698:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:2.0:1787572428.983702:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572428.983705:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671e00, rc 0) 00000100:00100000:2.0:1787572428.983768:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+52:10545:x1874405244325504:12345-192.168.204.55@tcp:101:bash.0 Request processed in 969us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572428.983775:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:2.0:1787572428.995572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572428.995733:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244325760 00000100:00100000:0.0:1787572428.995744:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244325760 00000100:00100000:0.0:1787572428.995803:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:0.0:1787572428.995814:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+52:10545:x1874405244325760:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:0.0:1787572428.996075:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+53:10545:x1874405244325760:12345-192.168.204.55@tcp:35:bash.0 Request processed in 262us (514us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787572428.996084:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:1.0:1787572429.119466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572429.119568:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244325888 00000100:00100000:0.0:1787572429.119589:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244325888 00000100:00100000:0.0:1787572429.119677:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 107 00000100:00100000:0.0:1787572429.119824:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+53:10551:x1874405244325888:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572429.119849:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572429.119871:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436ac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbadf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.119934:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.119947:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.119958:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572429.120185:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787572429.120190:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572429.120215:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.120527:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f436ac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbadf expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.120546:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbadf expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.120555:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:0.0:1787572429.120558:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572429.120561:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670600, rc 0) 00000100:00100000:0.0:1787572429.120736:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:10551:x1874405244325888:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1048us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572429.120744:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 107 00000100:00100000:0.0:1787572429.141575:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572429.141978:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244326016 00000100:00100000:3.0:1787572429.141988:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244326016 00000100:00100000:3.0:1787572429.142070:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:3.0:1787572429.142080:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:10551:x1874405244326016:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572429.142100:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572429.142121:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436ad1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbae6 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142184:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142199:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142210:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142236:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142254:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142261:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142373:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436ae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142382:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142389:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572429.142433:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787572429.142438:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572429.142457:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142470:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142477:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142483:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142489:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142494:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572429.142499:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142506:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142517:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572429.142520:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572429.142524:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142529:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436ad8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142551:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142557:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142563:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142567:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572429.142570:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142575:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142583:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c577c800) 00010000:00010000:3.0:1787572429.142585:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572429.142588:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142593:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142623:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436ad1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbae6 expref: 56 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142829:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbae6 expref: 55 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.142849:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572429.142851:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572429.142854:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb600, rc 0) 00000100:00100000:3.0:1787572429.142924:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:10551:x1874405244326016:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 846us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572429.142931:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:2.0:1787572429.152554:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572429.152733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572429.152888:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244326400 00000100:00100000:3.0:1787572429.152910:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244326400 00000100:00100000:3.0:1787572429.152978:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1787572429.152990:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:2355:x1874405244326400:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572429.153005:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572429.153037:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436ae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbae6 expref: 55 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.153055:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572429.153060:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572429.153114:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:2355:x1874405244326400:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 126us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572429.153120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:1.0:1787572429.161803:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244326272 00000100:00100000:1.0:1787572429.161819:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244326272 00000100:00100000:1.0:1787572429.161876:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:1.0:1787572429.161886:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:10551:x1874405244326272:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572429.161917:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572429.161938:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436aed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbaed expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.162345:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.162361:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.162370:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.162409:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.162422:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 55 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572429.162436:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268460160:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572429.162535:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86900 going to sleep for 11 seconds 00000100:00100000:2.0:1787572429.169482:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572429.170866:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244326528 00000100:00100000:3.0:1787572429.170878:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244326528 00010000:00010000:3.0:1787572429.170944:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 56 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572429.170989:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:3.0:1787572429.171003:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+56:2353:x1874405244326528:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572429.171038:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572429.171046:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 56 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.171060:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 56 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.171080:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572429.171084:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.171092:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.171100:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.171116:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572429.171170:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+56:2353:x1874405244326528:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 174us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572429.171178:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00010000:00010000:1.0:1787572429.171865:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436abc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbad8 expref: 55 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572429.171884:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268460160:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572429.171915:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.171924:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.171949:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572429.171967:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787572429.172113:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436aed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.172127:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.172136:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572429.172138:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787572429.172141:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462e00, rc 0) 00000100:00100000:1.0:1787572429.172181:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:10551:x1874405244326272:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 10297us (19638us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787572429.172188:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:2.0:1787572429.181105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572429.181356:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244326784 00000100:00100000:3.0:1787572429.181367:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244326784 00000100:00100000:3.0:1787572429.181430:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:3.0:1787572429.181440:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:10551:x1874405244326784:12345-192.168.204.55@tcp:103:lfs.0 00010000:00010000:3.0:1787572429.181457:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572429.181480:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbac3 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.181514:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572429.181519:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572429.181575:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:10551:x1874405244326784:12345-192.168.204.55@tcp:103:lfs.0 Request processed in 136us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572429.181582:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:2.0:1787572429.183574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572429.183680:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244326912 00000100:00100000:3.0:1787572429.183696:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244326912 00000100:00100000:3.0:1787572429.183738:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:3.0:1787572429.183747:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:10551:x1874405244326912:12345-192.168.204.55@tcp:58:lfs.0 00010000:00010000:3.0:1787572429.183855:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.183871:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572429.183882:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787572429.184293:0:7555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787572429.184394:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:10551:x1874405244326912:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 647us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572429.184403:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:2.0:1787572429.194266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572429.194444:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244327040 00000100:00100000:0.0:1787572429.194455:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244327040 00000100:00100000:0.0:1787572429.194516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 111 00000100:00100000:0.0:1787572429.194527:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:10551:x1874405244327040:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572429.194549:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572429.194572:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbaf4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.194628:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.194679:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaf4 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.194800:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.194814:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaf4 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.194827:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:0.0:1787572429.194830:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787572429.194834:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaf4 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.194856:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671800, rc 0) 00000100:00100000:0.0:1787572429.194917:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:10551:x1874405244327040:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 391us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572429.194923:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 111 00010000:00010000:2.0:1787572429.615505:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787572429.920841:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787572429.920865:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787572429.920871:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787572429.920877:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787572429.961938:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000020:00080000:1.0:1787572429.962009:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d1c5a96c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787572429.962016:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1cdfd6100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d1c5a963c0 00000020:00080000:1.0:1787572429.962020:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1cdfd6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d1f3e68c00 00000020:00080000:0.0:1787572429.962136:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:0.0:1787572429.962413:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1787572429.963813:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:1.0:1787572429.963885:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787572429.963918:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d1d07e1cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787572429.963922:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1fc0ec500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d1d07e1c00 00000020:00080000:1.0:1787572429.963926:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1fc0ecc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d1c50c3800 00000004:00080000:1.0:1787572429.964240:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787572429.964370:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787572429.964431:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787572429.964495:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268460288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787572429.964585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572429.964762:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268460288 00000100:00100000:0.0:1787572429.964771:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268460288 00000100:00100000:0.0:1787572429.964831:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787572429.964842:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268460288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787572429.964875:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1787572429.964916:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c30ca, atime: 0x6a8c30ca, ctime: 0x6a8c30ca, blocks: 0x1 00010000:00010000:0.0:1787572429.964925:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.964956:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1787572429.964962:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572429.964969:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.965003:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.965015:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.965024:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.965039:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787572429.965607:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874405268460288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 763us (1019us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787572429.965618:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1787572429.965976:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1f450ed80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787572429.965985:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268460288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787572429.966011:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572429.966022:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268460416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787572429.966059:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572429.966212:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268460416 00000100:00100000:0.0:1787572429.966219:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268460416 00000100:00100000:0.0:1787572429.966327:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787572429.966336:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268460416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787572429.966365:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787572429.966395:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.966419:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 5 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.966428:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787572429.966440:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787572429.966445:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.966484:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 5 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.966500:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 5 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572429.966513:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1874405268460544:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572429.966578:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96180 going to sleep for 11 seconds 00010000:00010000:1.0:1787572429.967969:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572429.967983:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.967998:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572429.968003:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.968023:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.968049:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.968057:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f436b10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572429.968087:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572429.968089:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572429.968091:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572429.969987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572429.970153:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1874405268460544:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572429.970187:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572429.970261:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244327168 00000100:00100000:3.0:1787572429.970269:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244327168 00000100:00080000:2.0:1787572429.972859:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787572429.974980:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 6 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572429.975079:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:2.0:1787572429.975096:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244327168:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572429.975118:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572429.975125:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 6 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.975141:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 6 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.975175:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f436957 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dba84 expref: 6 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.975198:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572429.975203:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572429.975210:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.975232:0:7642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.975463:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572429.975550:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244327168:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 459us (5574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572429.975559:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00010000:00010000:0.0:1787572429.980613:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.980660:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.980687:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.980697:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572429.980728:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787572429.981043:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572429.981053:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.981064:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671e00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572429.981070:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.981080:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.981108:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.981116:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f436b17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572429.981145:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572429.981147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572429.981149:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572429.982954:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268460416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16610us (16886us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787572429.982969:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787572429.986460:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1787572429.986476:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d1f4513100, transno 4294967303 00000004:00080000:3.0:1787572429.986562:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1787572429.986598:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98d1f40efb80 x1874405268460416/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787572445 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787572429.986612:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1f40efb80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787572429.992267:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268460416:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1787572430.064075:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787572430.064087:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787572430.064163:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787572430.064170:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787572430.064476:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268460672:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787572430.064618:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0540 going to sleep for 11 seconds 00000100:00100000:1.0:1787572430.074987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572430.076148:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268460672:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787572430.076905:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244327296 00000100:00100000:3.0:1787572430.076916:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244327296 00000100:00100000:3.0:1787572430.077019:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 112 00000100:00100000:3.0:1787572430.077031:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10552:x1874405244327296:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787572430.077070:0:7555:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787572430.077215:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10552:x1874405244327296:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 186us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572430.077232:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 112 00000100:00080000:2.0:1787572430.078558:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572430.094553:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572430.094688:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244327424 00000100:00100000:3.0:1787572430.094702:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244327424 00000100:00100000:3.0:1787572430.094783:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:3.0:1787572430.094795:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10552:x1874405244327424:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787572430.095041:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095084:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095100:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095119:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095127:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095133:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095172:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095182:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095189:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572430.095252:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787572430.095257:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572430.095272:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095285:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095302:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095310:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095317:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eac00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572430.095322:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095331:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095461:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:3.0:1787572430.095465:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572430.095471:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095478:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095494:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095500:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095507:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095512:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572430.095520:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095527:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095535:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff98d1c577c200) 00010000:00010000:3.0:1787572430.095538:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572430.095541:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095547:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095563:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095569:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095576:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095580:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572430.095583:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095589:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095595:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572430.095597:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572430.095604:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.095611:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.096539:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10552:x1874405244327424:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 1738us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572430.096552:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:0.0:1787572430.128204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572430.128307:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244327680 00000100:00100000:3.0:1787572430.128320:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244327680 00000100:00100000:3.0:1787572430.128403:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:3.0:1787572430.128414:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10552:x1874405244327680:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572430.128441:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572430.128467:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbafb expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.128585:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.128605:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.128617:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572430.128628:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787572430.131649:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.131766:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.131776:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.131783:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572430.131788:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.131797:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.131876:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:2.0:1787572430.131880:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787572430.131886:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.131893:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436b3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.131961:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b33 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbafb expref: 15 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.131972:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:2.0:1787572430.131975:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787572430.131979:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436b33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbafb expref: 15 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.132005:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea200, rc 0) 00000100:00100000:2.0:1787572430.132086:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10552:x1874405244327680:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 3673us (3896us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787572430.132097:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:2.0:1787572430.144386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.144477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244327808 00000100:00100000:1.0:1787572430.144510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244327808 00000100:00100000:1.0:1787572430.144577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:1.0:1787572430.144589:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10552:x1874405244327808:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787572430.144679:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787572430.144797:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10552:x1874405244327808:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 210us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.144805:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:0.0:1787572430.178737:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.179472:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244328064 00000100:00100000:1.0:1787572430.179487:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244328064 00000100:00100000:1.0:1787572430.179575:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:1.0:1787572430.179588:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10552:x1874405244328064:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572430.179618:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572430.179622:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787572430.179704:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436aca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbadf expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.179923:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572430.179930:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572430.179949:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436b48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb02 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787572430.180946:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787572430.181242:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436b4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.181260:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.181284:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.181352:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436b48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb02 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.181371:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb02 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.181381:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572430.181384:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787572430.181387:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462000, rc 0) 00000100:00100000:1.0:1787572430.181465:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10552:x1874405244328064:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1880us (2752us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787572430.181474:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:0.0:1787572430.187060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.187528:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244328320 00000100:00100000:1.0:1787572430.187542:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244328320 00000100:00100000:1.0:1787572430.187615:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 117 00000100:00100000:1.0:1787572430.187627:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10552:x1874405244328320:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787572430.188042:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572430.188079:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb02 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.188101:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572430.188114:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572430.188142:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.188174:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.188185:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189053:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189076:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189089:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189416:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189424:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189432:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189438:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572430.189442:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189725:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189738:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:1.0:1787572430.189749:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572430.189754:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189759:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436b5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189774:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189779:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189785:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189791:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572430.189794:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189799:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189807:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x59c1d64f (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572430.189810:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572430.189812:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.189818:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x59c1d64f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.190109:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10552:x1874405244328320:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 2470us (3049us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787572430.190125:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 117 00000100:00100000:0.0:1787572430.193889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.194113:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244328448 00000100:00100000:1.0:1787572430.194127:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244328448 00000100:00100000:1.0:1787572430.194209:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:1.0:1787572430.194231:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10552:x1874405244328448:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572430.194261:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572430.194295:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436b6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb09 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.194340:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.194357:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.194371:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.194504:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436b6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.194526:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.194535:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:1.0:1787572430.194538:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787572430.194542:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462200, rc 0) 00000100:00100000:1.0:1787572430.194617:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10552:x1874405244328448:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 398us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.194631:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:0.0:1787572430.201379:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572430.201519:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244328704 00000100:00100000:3.0:1787572430.201534:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244328704 00000100:00100000:3.0:1787572430.201607:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 119 00000100:00100000:3.0:1787572430.201618:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10552:x1874405244328704:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787572430.202045:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.202068:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.202082:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787572430.202472:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1787572430.202484:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360298847981ns, next at 361298845481ns, rc = 0 00000004:00010000:3.0:1787572430.202590:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063a08143 reply state 00000000052da256 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.202600:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787572430.208718:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:10552:x1874405244328704:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 7081us (7336us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787572430.208736:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 119 00010000:00010000:1.0:1787572430.212007:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.212030:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.212039:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.212046:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eac00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572430.212052:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.212062:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.212086:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:1.0:1787572430.212089:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787572430.212095:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.212101:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f436b79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572430.231139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572430.233429:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244328832 00000100:00100000:0.0:1787572430.233447:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244328832 00000100:00100000:0.0:1787572430.233580:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:0.0:1787572430.233594:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10552:x1874405244328832:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572430.233627:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572430.233681:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb10 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.233773:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 17 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.233791:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 17 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.233829:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:0.0:1787572430.233832:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787572430.233838:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670400, rc 0) 00000100:00100000:0.0:1787572430.234990:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:10552:x1874405244328832:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 334us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572430.235025:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:0.0:1787572430.247624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.248128:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244328960 00000100:00100000:1.0:1787572430.248142:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244328960 00000100:00100000:1.0:1787572430.248231:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:1.0:1787572430.248245:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244328960:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787572430.249172:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244328960:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 925us (1559us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787572430.249201:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:2.0:1787572430.256288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.256440:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244329216 00000100:00100000:1.0:1787572430.256454:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244329216 00000100:00100000:1.0:1787572430.256527:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:1.0:1787572430.256541:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:10552:x1874405244329216:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787572430.257063:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10552:x1874405244329216:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 525us (791us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787572430.257072:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:2.0:1787572430.262328:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572430.262480:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244329472 00000100:00100000:3.0:1787572430.262494:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244329472 00000100:00100000:3.0:1787572430.262568:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:3.0:1787572430.262579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10552:x1874405244329472:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787572430.262778:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10552:x1874405244329472:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 201us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572430.262786:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:0.0:1787572430.265397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.265486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244329600 00000100:00100000:1.0:1787572430.265499:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244329600 00000100:00100000:1.0:1787572430.265564:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:1.0:1787572430.265574:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10552:x1874405244329600:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572430.265598:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572430.265622:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436b87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb17 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.266003:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.266021:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.266035:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572430.266081:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572430.266102:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.266152:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436b87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb17 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.266174:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb17 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.266185:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:1.0:1787572430.266187:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787572430.266192:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463e00, rc 0) 00000100:00100000:1.0:1787572430.266324:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10552:x1874405244329600:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 751us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.266333:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:2.0:1787572430.274568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572430.275308:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244329728 00000100:00100000:3.0:1787572430.275321:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244329728 00000100:00100000:3.0:1787572430.275399:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:3.0:1787572430.275411:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244329728:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572430.275450:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572430.275476:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb1e expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787572430.275511:0:12010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c30cc, blocks: 0x1 00010000:00010000:3.0:1787572430.275534:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1787572430.275539:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572430.275551:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.275573:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.275588:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eac00, rc 0) 00000100:00100000:3.0:1787572430.275732:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244329728:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 314us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572430.275741:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:2.0:1787572430.289938:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572430.290080:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244329984 00000100:00100000:3.0:1787572430.290094:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244329984 00000100:00100000:3.0:1787572430.290166:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:3.0:1787572430.290177:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10552:x1874405244329984:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787572430.290328:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10552:x1874405244329984:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 152us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572430.290343:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:1.0:1787572430.296116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572430.297179:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244330112 00000100:00100000:2.0:1787572430.297197:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244330112 00000100:00100000:2.0:1787572430.297297:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1787572430.297310:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:10552:x1874405244330112:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787572430.297921:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572430.297954:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb25 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.298000:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 8 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.298012:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572430.298017:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572430.298023:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.298091:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 8 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.298108:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 8 pid: 12010 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572430.298126:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874405268460800:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572430.298274:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787572430.311841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572430.312853:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244330240 00000100:00100000:3.0:1787572430.312888:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244330240 00010000:00010000:3.0:1787572430.312945:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 9 pid: 12010 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.312988:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:3.0:1787572430.313000:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2353:x1874405244330240:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572430.313020:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572430.313049:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 9 pid: 12010 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.313065:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 9 pid: 12010 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.313097:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572430.313103:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572430.313113:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.313124:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.313171:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.313187:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1874405268460928:192.168.204.55@tcp:105: 00000100:00100000:3.0:1787572430.313318:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86780 going to sleep for 11 seconds 00010000:00010000:1.0:1787572430.313596:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f436b95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb1e expref: 9 pid: 12010 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.313615:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874405268460800:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572430.313697:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.313709:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277600, rc 0) 00000100:00100000:1.0:1787572430.313751:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:10552:x1874405244330112:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 16444us (17650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.313760:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1787572430.319419:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268461440:0@lo:400:kworker.0 00000100:00100000:2.0:1787572430.319518:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572430.319566:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572430.319572:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268461312:0@lo:400:kworker.0 00000100:00100000:2.0:1787572430.319593:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572430.319777:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268461440 00000100:00100000:0.0:1787572430.319788:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268461440 00000100:00100000:0.0:1787572430.319865:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268461312 00000100:00100000:0.0:1787572430.319867:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268461312 00000100:00100000:0.0:1787572430.319892:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787572430.319902:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268461440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572430.319971:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268461440:12345-0@lo:400:kworker.0 Request processed in 70us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572430.319979:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787572430.319996:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787572430.320002:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268461312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572430.320024:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268461312:12345-0@lo:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572430.320029:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787572430.320199:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268461184:0@lo:400:kworker.0 00000100:00100000:3.0:1787572430.320244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572430.320272:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572430.320277:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268461056:0@lo:400:kworker.0 00000100:00100000:3.0:1787572430.320306:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572430.321240:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268461056 00000100:00100000:1.0:1787572430.321271:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268461056 00000100:00100000:1.0:1787572430.321320:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787572430.321328:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268461056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572430.321405:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268461056:12345-0@lo:400:kworker.0 Request processed in 77us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.321413:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787572430.321465:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268461056:0@lo:400:kworker.0 00000100:00100000:1.0:1787572430.321494:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268461184 00000100:00100000:1.0:1787572430.321497:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268461184 00000100:00100000:1.0:1787572430.321520:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787572430.321526:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268461184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572430.321558:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268461184:12345-0@lo:400:kworker.0 Request processed in 33us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.321563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787572430.321587:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268461184:0@lo:400:kworker.0 00000100:00080000:2.0:1787572430.323063:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572430.323108:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268461312:0@lo:400:kworker.0 00000100:00100000:2.0:1787572430.323123:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268461440:0@lo:400:kworker.0 00000100:00100000:1.0:1787572430.323985:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1874405268460928:192.168.204.55@tcp:105: 00010000:00010000:1.0:1787572430.324012:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572430.324087:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244330240:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 11087us (12261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.324097:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:2.0:1787572430.325036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572430.325920:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244330368 00000100:00100000:0.0:1787572430.325933:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244330368 00002000:00100000:0.0:1787572430.325999:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98d1f4510700 x1874405244330368/t0(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:466/0 lens 504/0 e 0 to 0 dl 1787572441 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787572430.326012:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f4510700 with x1874405244330368 ext(0->12) 00002000:00010000:0.0:1787572430.326020:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f4510700 00000100:00100000:0.0:1787572430.326056:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1787572430.326067:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244330368:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787572430.327746:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2353:x1874405244330368:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 Request processed in 1670us (2704us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787572430.327761:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00002000:00100000:0.0:1787572430.327772:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98d1f4510700 x1874405244330368/t4294967309(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:466/0 lens 504/448 e 0 to 0 dl 1787572441 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787572430.327783:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f4510700 with x1874405244330368 ext(0->12) 00002000:00010000:0.0:1787572430.327789:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f4510700 00000100:00100000:2.0:1787572430.336513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572430.337006:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244330496 00000100:00100000:0.0:1787572430.337019:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244330496 00000100:00100000:0.0:1787572430.337102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00100000:0.0:1787572430.337116:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:10552:x1874405244330496:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00000020:00080000:1.0:1787572430.423351:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787572430.423371:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000001:00080000:1.0:1787572430.423390:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787572430.423412:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:3.0:1787572430.423516:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10552:x1874405244330496:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 86396us (87011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572430.423530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 124 00000020:00080000:0.0:1787572430.423597:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1787572430.423613:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1787572430.424071:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572430.424230:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268461568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787572430.424302:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572430.425898:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268461568 00000100:00100000:1.0:1787572430.425912:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268461568 00000100:00100000:1.0:1787572430.426088:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787572430.426100:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874405268461568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787572430.426400:0:12010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787572430.426404:0:12010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787572428 00002000:00010000:1.0:1787572430.426407:0:12010:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787572430.426410:0:12010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787572428 -> 1787572428 00002000:00010000:1.0:1787572430.426412:0:12010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787572430.426485:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874405268461568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 388us (2183us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787572430.426492:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1787572430.426579:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1f40c6300/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787572430.426587:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268461568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787572430.428621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.429155:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244330624 00000100:00100000:1.0:1787572430.429166:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244330624 00000100:00100000:1.0:1787572430.429245:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:1.0:1787572430.429259:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2353:x1874405244330624:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787572430.590458:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1787572430.590490:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1787572430.590499:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1787572430.591583:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244330624:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 162315us (162961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572430.591607:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1787572430.596382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572430.597999:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244330880 00000100:00100000:0.0:1787572430.598018:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244330880 00000100:00100000:0.0:1787572430.599220:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00100000:0.0:1787572430.599248:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10552:x1874405244330880:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787572430.599345:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572430.599399:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436b8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb17 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.599430:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:0.0:1787572430.599458:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572430.599510:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.599528:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.599541:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787572430.599977:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4ce6f15 reply state 0000000081efd520 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572430.599990:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787572430.600127:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:10552:x1874405244330880:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 892us (3760us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787572430.600136:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00100000:1.0:1787572430.605235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572430.605477:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244331008 00000100:00100000:2.0:1787572430.605508:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244331008 00000100:00100000:2.0:1787572430.605585:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:2.0:1787572430.605912:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244331008:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1787572430.607140:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.607159:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.607168:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.607186:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572430.607192:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.607201:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.607264:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:0.0:1787572430.607268:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572430.607275:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.607282:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f436ba3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572430.607519:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787572430.607525:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787572428 -> 1787572427 00002000:00010000:2.0:1787572430.607528:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787572426 00002000:00010000:2.0:1787572430.607530:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787572428 -> 1787572427 00002000:00010000:2.0:1787572430.607533:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787572430.607849:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244331008:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 2247us (2649us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787572430.607860:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:3.0:1787572430.614263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572430.615331:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244331264 00000100:00100000:0.0:1787572430.615351:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244331264 00000100:00100000:0.0:1787572430.615465:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:0.0:1787572430.615479:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:10552:x1874405244331264:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787572430.615592:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.615615:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.615626:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.615702:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572430.615718:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 15 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572430.615737:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268461696:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572430.617952:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96540 going to sleep for 11 seconds 00000100:00100000:2.0:1787572430.622908:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268461696:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572430.622958:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.625574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.625857:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244331392 00000100:00100000:1.0:1787572430.625874:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244331392 00010000:00010000:1.0:1787572430.625948:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 16 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.626011:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:1.0:1787572430.626025:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:2353:x1874405244331392:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572430.626049:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572430.626057:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 16 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.626075:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 16 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.626132:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb09 expref: 16 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.626159:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:1.0:1787572430.626165:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.626179:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.626189:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.626244:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572430.626338:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:2353:x1874405244331392:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 316us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.626348:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 55 00010000:00010000:3.0:1787572430.626988:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.627002:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.627048:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.627058:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.627082:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.627091:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572430.627097:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.627107:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.627124:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:3.0:1787572430.627128:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787572430.627132:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.627140:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436baa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.627233:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10552:x1874405244331264:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 Request processed in 11754us (12987us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787572430.627245:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:3.0:1787572430.633300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572430.633467:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244331520 00000100:00100000:2.0:1787572430.633481:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244331520 00000100:00100000:2.0:1787572430.633552:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:2.0:1787572430.633563:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244331520:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787572430.633981:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.634011:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.634021:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572430.634043:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572430.634048:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.634095:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.634112:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 7 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572430.634132:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874405268461824:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572430.634257:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0480 going to sleep for 11 seconds 00010000:00010000:1.0:1787572430.639962:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572430.648833:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572430.649533:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874405268461824:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572430.649561:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.651731:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244331648 00000100:00100000:1.0:1787572430.651746:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244331648 00010000:00010000:1.0:1787572430.651788:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 8 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.651831:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:1.0:1787572430.651841:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244331648:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572430.651858:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572430.651882:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 8 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.651912:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 8 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.651936:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f436b9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb25 expref: 8 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.651952:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787572430.651957:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787572430.651963:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.651972:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.652005:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787572430.652069:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.652078:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244331648:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 235us (3253us total) trans 0 rc 0/0 00010000:00010000:2.0:1787572430.652089:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.652094:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 56 00010000:00010000:2.0:1787572430.652121:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.652131:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.652147:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.652154:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572430.652159:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.652169:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.652181:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.652189:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686a5010/0x9fe530ef4f436bb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572430.652255:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244331520:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 18692us (18969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572430.652262:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:0.0:1787572430.655001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572430.655191:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244331904 00000100:00100000:2.0:1787572430.655201:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244331904 00000100:00100000:2.0:1787572430.655260:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 127 00000100:00100000:2.0:1787572430.655270:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10552:x1874405244331904:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787572430.655350:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.655382:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.655393:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.655597:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.655609:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 15 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.655617:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.655776:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 15 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.655789:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 15 pid: 7555 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572430.655804:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268461952:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572430.655982:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787572430.661469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.661532:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244332032 00000100:00100000:1.0:1787572430.661542:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244332032 00010000:00010000:1.0:1787572430.661583:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 16 pid: 7555 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.661626:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:1.0:1787572430.661673:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:2354:x1874405244332032:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572430.661704:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572430.661712:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 16 pid: 7555 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.661727:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 16 pid: 7555 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.661751:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:1.0:1787572430.661756:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.661765:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.661773:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.661791:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572430.661834:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:2354:x1874405244332032:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 200us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.661841:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00010000:00010000:2.0:1787572430.667278:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436b80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb10 expref: 15 pid: 7555 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572430.667303:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268461952:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572430.667326:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.668437:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.668444:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572430.669036:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787572430.671406:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787572430.671459:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787572430.672247:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874405268462080:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787572430.672436:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572430.672525:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572430.673141:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268462080 00000100:00100000:0.0:1787572430.673200:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268462080 00000100:00100000:0.0:1787572430.673275:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787572430.673285:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874405268462080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787572430.673395:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874405268462080:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572430.673402:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787572430.673456:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787572430.673462:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d1f40efb80, transno 4294967307 00000004:00080000:2.0:1787572430.673477:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d1f40c6300, transno 4294967310 00000100:00100000:2.0:1787572430.673485:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874405268462080:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787572430.674573:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1787572430.674681:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f42ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874405268462208:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787572430.674726:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572430.674755:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787572430.675980:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268462208 00000100:00100000:1.0:1787572430.675990:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268462208 00000100:00100000:1.0:1787572430.676041:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787572430.676050:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874405268462208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787572430.676278:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1874405268462208:12345-0@lo:1000:mdt00_001.0 Request processed in 228us (1551us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787572430.676286:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787572430.677353:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f42ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1874405268462208:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787572430.677402:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677423:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677431:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677438:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572430.677443:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677451:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677470:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0be00) 00010000:00010000:3.0:1787572430.677474:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572430.677478:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677503:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436bbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677538:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677544:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677550:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677555:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572430.677565:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677571:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677580:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572430.677583:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572430.677590:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaf4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677602:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaf4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677622:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaf4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.677679:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaf4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.677694:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268462336:192.168.204.55@tcp:105: 00000100:00100000:3.0:1787572430.677775:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572430.683707:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268462336:192.168.204.55@tcp:105: 00010000:00010000:3.0:1787572430.683747:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683758:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436b02 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683809:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683824:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683835:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683847:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683854:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683860:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683867:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572430.683871:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683879:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683901:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572430.683904:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572430.683907:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683913:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bc6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683935:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683942:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683947:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683952:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572430.683955:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683962:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683970:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572430.683972:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787572430.683975:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572430.683981:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436bb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.684194:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10552:x1874405244331904:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 28923us (29200us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787572430.684204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 127 00000020:00080000:3.0:1787572430.684221:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787572430.684307:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787572430.684313:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787572430.684894:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787572430.684902:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787572430.685848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.686049:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244332160 00000100:00100000:1.0:1787572430.686058:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244332160 00000100:00100000:1.0:1787572430.686106:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:1.0:1787572430.686116:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10551:x1874405244332160:12345-192.168.204.55@tcp:49:lfs.0 00000100:00100000:1.0:1787572430.686237:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10551:x1874405244332160:12345-192.168.204.55@tcp:49:lfs.0 Request processed in 123us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.686245:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:3.0:1787572430.686836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.687817:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244332416 00000100:00100000:1.0:1787572430.687826:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244332416 00000100:00100000:1.0:1787572430.688204:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:1.0:1787572430.688226:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7481050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:10552:x1874405244332416:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787572430.688909:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787572430.689122:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787572430.689168:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.689184:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.689196:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.689205:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.689225:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.689232:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.689267:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787572430.689355:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7481050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:10552:x1874405244332416:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1129us (2517us total) trans 4294967408 rc 0/0 00010000:00010000:2.0:1787572430.689360:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787572430.689365:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 32 00010000:00010000:2.0:1787572430.689372:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787572430.689373:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787572430.689383:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572430.689388:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.689396:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.689419:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:2.0:1787572430.689423:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787572430.689428:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.689434:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436bcd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.689453:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572430.689455:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572430.689457:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572430.695768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572430.695864:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244332672 00000100:00100000:3.0:1787572430.695899:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244332672 00000100:00100000:3.0:1787572430.696253:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 128 00000100:00100000:3.0:1787572430.696265:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:10551:x1874405244332672:12345-192.168.204.55@tcp:58:lfs.0 00000040:00080000:3.0:1787572430.696595:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787572430.697010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:10551:x1874405244332672:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 746us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572430.697019:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 128 00000100:00100000:0.0:1787572430.761598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572430.761797:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244332800 00000100:00100000:2.0:1787572430.761809:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244332800 00000100:00100000:2.0:1787572430.762286:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 129 00000100:00100000:2.0:1787572430.762298:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:10555:x1874405244332800:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572430.762323:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572430.762346:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436bd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb2c expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762412:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762427:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762438:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762454:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762476:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762483:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762827:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762839:0:7555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762848:0:7555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762893:0:7555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.762908:0:7555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 21 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572430.762940:0:7555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7555:1874405268462464:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572430.763036:0:7555:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572430.766898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572430.767005:0:7555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7555:1874405268462464:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572430.767033:0:7555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572430.767198:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244333056 00000100:00100000:3.0:1787572430.767216:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244333056 00000100:00100000:3.0:1787572430.767310:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1787572430.767321:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:5594:x1874405244333056:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787572430.767570:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:5594:x1874405244333056:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 250us (692us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787572430.767578:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:0.0:1787572430.769988:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572430.770138:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244333184 00000100:00100000:1.0:1787572430.770147:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244333184 00010000:00010000:1.0:1787572430.770188:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 23 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572430.770244:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:1.0:1787572430.770255:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:2354:x1874405244333184:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572430.770272:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572430.770279:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 23 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.770295:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 23 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.770316:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436af4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaed expref: 23 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.770333:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572430.770339:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.770350:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.770373:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572430.770409:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572430.770464:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:2354:x1874405244333184:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 210us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572430.770471:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00010000:00010000:2.0:1787572430.770681:0:7555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770696:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572430.770738:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787572430.770743:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572430.770763:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770776:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770785:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770791:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770798:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770804:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572430.770808:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770816:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770825:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:2.0:1787572430.770828:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572430.770832:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770850:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770862:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770868:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770874:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770879:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572430.770883:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770888:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770896:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d1c3a46a00) 00010000:00010000:2.0:1787572430.770899:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572430.770902:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770908:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436be2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770960:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436bd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb2c expref: 22 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770975:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb2c expref: 21 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572430.770988:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:2.0:1787572430.770991:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572430.770994:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277a00, rc 0) 00000100:00100000:2.0:1787572430.771022:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10555:x1874405244332800:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 8727us (9439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572430.771029:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 129 00000100:00100000:1.0:1787572430.832494:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572430.832530:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268462592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572430.832619:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572430.832911:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268462592 00000100:00100000:2.0:1787572430.832919:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268462592 00000100:00100000:2.0:1787572430.832989:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787572430.833000:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268462592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572430.833022:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787572430.833074:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268462592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572430.833081:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787572430.833378:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268462592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572431.167047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572431.167093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572431.167116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572431.167147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572431.167174:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244333568 00000100:00100000:0.0:1787572431.167184:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244333568 00000100:00100000:3.0:1787572431.167225:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244333312 00000100:00100000:3.0:1787572431.167232:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244333312 00000100:00100000:0.0:1787572431.167254:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244333440 00000100:00100000:0.0:1787572431.167259:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244333440 00000100:00100000:3.0:1787572431.167286:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 291 00000100:00100000:0.0:1787572431.167291:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:3.0:1787572431.167302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2355:x1874405244333312:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572431.167306:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244333568:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572431.167695:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244333568:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 394us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572431.167713:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:0.0:1787572431.167733:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:0.0:1787572431.167740:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244333440:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572431.175790:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2355:x1874405244333312:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 8475us (8742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572431.175808:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 291 00000100:00100000:0.0:1787572431.181194:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244333440:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 13439us (14061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572431.181220:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:0.0:1787572431.181280:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244333696 00000100:00100000:0.0:1787572431.181289:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244333696 00000100:00100000:0.0:1787572431.181384:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 147 00000100:00100000:0.0:1787572431.181393:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2355:x1874405244333696:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572431.181441:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2355:x1874405244333696:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 51us (14294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572431.181448:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 147 00000100:00080000:2.0:1787572431.189842:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787572431.189852:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572431.189856:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787572431.346451:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572431.346474:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268462720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572431.346561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572431.346626:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268462720 00000100:00100000:2.0:1787572431.346668:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268462720 00000100:00100000:2.0:1787572431.346735:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787572431.346745:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268462720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572431.346781:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572431.346824:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268462720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572431.347085:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787572431.347107:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572431.347138:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268462720:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787572431.454732:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1787572431.454757:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:2.0:1787572431.660568:0:12121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787572431.660578:0:12121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787572431.660624:0:12121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787572431.660630:0:12121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787572431.663681:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787572431.729520:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787572431.729529:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787572431.729566:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787572431.729572:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787572431.731215:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268462848:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787572431.731312:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1de013a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787572431.752036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572431.752121:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268462848:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787572431.752588:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244333824 00000100:00100000:0.0:1787572431.752596:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244333824 00000100:00100000:0.0:1787572431.752674:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 130 00000100:00100000:0.0:1787572431.752685:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10567:x1874405244333824:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787572431.752740:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787572431.752844:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10567:x1874405244333824:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 161us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572431.752851:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 130 00000100:00100000:0.0:1787572431.759617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572431.760757:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244334080 00000100:00100000:3.0:1787572431.760777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244334080 00000100:00100000:3.0:1787572431.760854:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 131 00000100:00100000:3.0:1787572431.760866:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:10567:x1874405244334080:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572431.760887:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572431.760907:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436bf0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb33 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.761018:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.761033:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.761044:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572431.761055:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787572431.761206:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436bf0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb33 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.761226:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb33 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.761234:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572431.761237:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572431.761242:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea200, rc 0) 00000100:00100000:3.0:1787572431.761308:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:10567:x1874405244334080:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 444us (1701us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787572431.761316:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 131 00000100:00100000:0.0:1787572431.766662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572431.766701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572431.766805:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244334464 00000100:00100000:1.0:1787572431.766815:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244334464 00000100:00100000:1.0:1787572431.766874:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1787572431.766885:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:2354:x1874405244334464:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572431.766913:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572431.766937:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436bf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb33 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572431.766953:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572431.766957:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572431.767008:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:2354:x1874405244334464:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 124us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572431.767015:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:3.0:1787572431.767605:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244334336 00000100:00100000:3.0:1787572431.767612:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244334336 00000100:00100000:3.0:1787572431.767675:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 132 00000100:00100000:3.0:1787572431.767683:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:10567:x1874405244334336:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787572431.767751:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.767767:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.767776:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.767987:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.767997:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.768003:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.768011:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572431.768016:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.768184:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.768209:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572431.768212:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787572431.768224:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572431.768231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436c05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572431.768370:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:10567:x1874405244334336:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 687us (1747us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787572431.768379:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 132 00000040:00080000:0.0:1787572431.768756:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787572431.768762:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787572431.769509:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787572431.769523:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787572431.772355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572431.772617:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244334720 00000100:00100000:3.0:1787572431.772627:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244334720 00000100:00100000:3.0:1787572431.772742:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:3.0:1787572431.772752:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:10567:x1874405244334720:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787572431.773294:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:10567:x1874405244334720:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 542us (947us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787572431.773303:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00010000:00010000:2.0:1787572432.686817:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787572433.609230:0:12172:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787572433.609239:0:12172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572433.609289:0:12172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787572433.609295:0:12172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787572433.713214:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572433.853113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572433.854209:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244334976 00000100:00100000:0.0:1787572433.854223:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244334976 00000100:00100000:1.0:1787572433.857720:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 133 00000100:00100000:1.0:1787572433.857736:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:10587:x1874405244334976:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572433.857766:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572433.857788:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb3a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.857904:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436c13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.857923:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.857935:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572433.857949:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787572433.858112:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb3a expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.858132:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb3a expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.858141:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572433.858144:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787572433.858163:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462200, rc 0) 00000100:00100000:1.0:1787572433.858235:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:10587:x1874405244334976:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 504us (5134us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787572433.858242:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 133 00000100:00080000:2.0:1787572433.858748:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572433.870821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572433.870904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244335104 00000100:00100000:1.0:1787572433.870914:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244335104 00000100:00100000:1.0:1787572433.870978:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 134 00000100:00100000:1.0:1787572433.870991:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:10587:x1874405244335104:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1787572433.871070:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871088:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871102:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871130:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871138:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871158:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871165:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572433.871170:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871178:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871191:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572433.871194:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572433.871200:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572433.871214:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572433.871291:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:10587:x1874405244335104:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 303us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572433.871299:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 134 00000100:00100000:1.0:1787572433.937043:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572433.937253:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244335232 00000100:00100000:0.0:1787572433.937265:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244335232 00000100:00080000:2.0:1787572433.937405:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572433.937459:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:0.0:1787572433.937472:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2355:x1874405244335232:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:0.0:1787572433.937490:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572433.937512:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b11eccb5/0x9fe530ef4f436c28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb41 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787572433.937540:0:12010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c30cb, atime: 0x6a8c30ca, ctime: 0x6a8c30cb, blocks: 0xb 00010000:00010000:0.0:1787572433.937560:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1787572433.937565:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572433.937575:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b11eccb5/0x9fe530ef4f436c28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb41 expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572433.937609:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b11eccb5/0x9fe530ef4f436c28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb41 expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572433.937623:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670000, rc 0) 00000100:00100000:0.0:1787572433.937710:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244335232:12345-192.168.204.55@tcp:101:cat.0 Request processed in 240us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572433.937736:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:2.0:1787572433.941732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572433.942457:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244335360 00000100:00100000:3.0:1787572433.942469:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244335360 00002000:00100000:3.0:1787572433.942522:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98d1fc4a4e00 x1874405244335360/t0(0) o3->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:469/0 lens 488/0 e 0 to 0 dl 1787572444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787572433.942534:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1fc4a4e00 with x1874405244335360 ext(0->4095) 00002000:00010000:3.0:1787572433.942540:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1fc4a4e00 00000100:00100000:3.0:1787572433.942677:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:3.0:1787572433.942689:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2356:x1874405244335360:12345-192.168.204.55@tcp:3:cat.0 00000100:00100000:3.0:1787572433.942984:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2356:x1874405244335360:12345-192.168.204.55@tcp:3:cat.0 Request processed in 296us (1262us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787572433.942993:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00002000:00100000:3.0:1787572433.943000:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98d1fc4a4e00 x1874405244335360/t0(0) o3->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:469/0 lens 488/4536 e 0 to 0 dl 1787572444 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787572433.943008:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1fc4a4e00 with x1874405244335360 ext(0->4095) 00002000:00010000:3.0:1787572433.943011:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1fc4a4e00 00010000:00010000:2.0:1787572434.738286:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787572434.862893:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787572434.862903:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787572434.862933:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787572434.862942:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787572435.441195:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268462976:0@lo:400:kworker.0 00000100:00100000:3.0:1787572435.441233:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268463232:0@lo:400:kworker.0 00000100:00100000:2.0:1787572435.441281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572435.441287:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572435.441783:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268463104:0@lo:400:kworker.0 00000100:00100000:3.0:1787572435.442106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268462976 00000100:00100000:3.0:1787572435.442114:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268462976 00000100:00100000:3.0:1787572435.442173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787572435.442182:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268462976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572435.442237:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268462976:12345-0@lo:400:kworker.0 Request processed in 55us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572435.442244:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787572435.442990:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268463360:0@lo:400:kworker.0 00000100:00100000:3.0:1787572435.443030:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572435.448302:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268462976:0@lo:400:kworker.0 00000100:00100000:2.0:1787572435.448321:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268463488:0@lo:400:kworker.0 00000100:00100000:2.0:1787572435.448386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572435.448427:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268463232 00000100:00100000:2.0:1787572435.448434:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268463232 00000100:00100000:2.0:1787572435.448491:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268463488 00000100:00100000:2.0:1787572435.448501:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268463488 00000100:00100000:2.0:1787572435.448534:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787572435.448542:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268463232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572435.448598:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268463232:12345-0@lo:400:kworker.0 Request processed in 56us (7313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572435.448604:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787572435.448622:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787572435.448630:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268463488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572435.448684:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268463488:12345-0@lo:400:kworker.0 Request processed in 55us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572435.448692:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1787572435.448715:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572435.448752:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268463232:0@lo:400:kworker.0 00000100:00100000:2.0:1787572435.448794:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268463488:0@lo:400:kworker.0 00000100:00100000:1.0:1787572435.455011:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268463360 00000100:00100000:1.0:1787572435.455028:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268463360 00000100:00100000:1.0:1787572435.455098:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787572435.455110:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268463360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572435.455227:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268463360:12345-0@lo:400:kworker.0 Request processed in 119us (12195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572435.455236:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1787572435.455774:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787572435.456328:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787572435.456336:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787572435.456365:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d1f450ed80, transno 4294967304 00000100:00100000:3.0:1787572435.456390:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268463360:0@lo:400:kworker.0 00000100:00100000:1.0:1787572435.457694:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572435.457736:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268463616:0@lo:400:kworker.0 00000100:00100000:2.0:1787572435.457739:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268463104 00000100:00100000:2.0:1787572435.457749:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268463104 00000100:00100000:2.0:1787572435.457800:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787572435.457800:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572435.457814:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268463104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572435.457830:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268463616 00000100:00100000:1.0:1787572435.457836:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268463616 00000100:00100000:2.0:1787572435.457874:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268463104:12345-0@lo:400:kworker.0 Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572435.457883:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787572435.457885:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787572435.457896:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268463616:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787572435.457916:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787572435.457935:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268463616:12345-0@lo:400:kworker.0 Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572435.457942:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787572435.457978:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268463616:0@lo:400:kworker.0 00000100:00100000:1.0:1787572435.458013:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268463104:0@lo:400:kworker.0 00000001:00080000:1.0:1787572435.529340:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000001:00080000:1.0:1787572435.529358:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787572435.529404:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d1c56c0f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787572435.529410:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1f48a1a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d1eb553000 00000020:00080000:1.0:1787572435.529413:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1f48a1600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d1f42b6400 00000020:00080000:0.0:1787572435.529843:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787572435.530028:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1787572435.599878:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1787572435.599912:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1787572435.760443:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572435.950818:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572435.950843:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268463744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572435.950916:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572435.950986:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268463744 00000100:00100000:1.0:1787572435.950993:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268463744 00000100:00100000:1.0:1787572435.951041:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787572435.951051:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268463744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787572435.951086:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572435.951144:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268463744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572435.951166:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787572435.951208:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787572435.951214:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787572435.951248:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268463744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572436.290178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572436.290222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572436.290258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572436.290301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572436.290326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572436.290416:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244335616 00000100:00100000:0.0:1787572436.290427:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244335616 00000100:00100000:0.0:1787572436.290493:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244336000 00000100:00100000:0.0:1787572436.290497:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244336000 00000100:00100000:0.0:1787572436.290520:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 151 00000100:00100000:0.0:1787572436.290529:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2356:x1874405244335616:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572436.290610:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2356:x1874405244335616:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 82us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572436.290618:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 151 00000100:00100000:0.0:1787572436.290663:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 152 00000100:00100000:0.0:1787572436.290672:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244336000:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572436.290700:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2356:x1874405244336000:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572436.290707:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 152 00000100:00100000:3.0:1787572436.290816:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244335488 00000100:00100000:3.0:1787572436.290821:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244335488 00000100:00100000:3.0:1787572436.290860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 293 00000100:00100000:3.0:1787572436.290878:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244335488:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572436.290907:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2356:x1874405244335488:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 40us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572436.290914:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 293 00000100:00100000:1.0:1787572436.291169:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244335872 00000100:00100000:1.0:1787572436.291174:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244335872 00000100:00100000:1.0:1787572436.291212:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244335744 00000100:00100000:1.0:1787572436.291216:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244335744 00000100:00100000:1.0:1787572436.291242:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:1.0:1787572436.291249:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244335872:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572436.291285:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2356:x1874405244335872:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 38us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572436.291292:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:1.0:1787572436.291305:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:1.0:1787572436.291312:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244335744:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572436.291334:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2356:x1874405244335744:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 23us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572436.291340:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00080000:2.0:1787572436.291903:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572436.291908:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787572436.291910:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572436.463205:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268463872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572436.463309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572436.463668:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268463872 00000100:00100000:1.0:1787572436.463677:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268463872 00000100:00100000:1.0:1787572436.463737:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787572436.463747:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268463872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787572436.463783:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572436.463839:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268463872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572436.463847:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787572436.464017:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268463872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787572436.785032:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572437.809261:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572438.831169:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572439.854837:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572440.559155:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f42ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268464128:0@lo:400:kworker.0 00000100:00100000:1.0:1787572440.559267:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572440.559343:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268464640:0@lo:400:kworker.0 00000100:00100000:1.0:1787572440.559403:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572440.559441:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572440.559461:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268464256:0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.559583:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268464000:0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.559627:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572440.559691:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268464512:0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.559719:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572440.559742:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787572440.559748:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268464384:0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.559772:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572440.559808:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268464128 00000100:00100000:0.0:1787572440.559817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268464128 00000100:00100000:0.0:1787572440.559870:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268464512 00000100:00100000:0.0:1787572440.559873:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268464512 00000100:00100000:0.0:1787572440.559905:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787572440.559915:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268464128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.559975:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268464128:12345-0@lo:400:kworker.0 Request processed in 61us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572440.559982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787572440.560000:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787572440.560006:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268464512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.560059:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268464512:12345-0@lo:400:kworker.0 Request processed in 53us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572440.560065:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787572440.560084:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268464640 00000100:00100000:0.0:1787572440.560088:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268464640 00000100:00100000:0.0:1787572440.560116:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268464384 00000100:00100000:0.0:1787572440.560120:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268464384 00000100:00100000:0.0:1787572440.560139:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787572440.560145:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268464640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.560178:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268464640:12345-0@lo:400:kworker.0 Request processed in 34us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572440.560184:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787572440.560202:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787572440.560207:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268464384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.560236:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268464384:12345-0@lo:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572440.560242:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787572440.560280:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268464384:0@lo:400:kworker.0 00000100:00100000:0.0:1787572440.560293:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268464512:0@lo:400:kworker.0 00000100:00100000:1.0:1787572440.560870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572440.560926:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f42ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268464128:0@lo:400:kworker.0 00000100:00100000:1.0:1787572440.560937:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268464640:0@lo:400:kworker.0 00000100:00100000:2.0:1787572440.561354:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268464256 00000100:00100000:2.0:1787572440.561361:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268464256 00000100:00100000:2.0:1787572440.561424:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787572440.561434:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268464256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572440.565050:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268464256:12345-0@lo:400:kworker.0 Request processed in 3604us (4167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572440.565071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787572440.565319:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268464000 00000100:00100000:3.0:1787572440.565331:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268464000 00000100:00100000:3.0:1787572440.565392:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787572440.565403:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268464000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572440.566705:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268464000:12345-0@lo:400:kworker.0 Request processed in 1297us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572440.566719:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787572440.567396:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268464256:0@lo:400:kworker.0 00000100:00080000:2.0:1787572440.568648:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572440.568659:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787572440.568664:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572440.568740:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268464000:0@lo:400:kworker.0 00000020:00080000:3.0:1787572440.697821:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787572440.699353:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787572440.699379:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787572440.881678:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572441.071093:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787572441.071126:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268464768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572441.071236:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572441.071416:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268464768 00000100:00100000:1.0:1787572441.071427:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268464768 00000100:00100000:1.0:1787572441.071505:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787572441.071517:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc3b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268464768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787572441.071567:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572441.071630:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc3b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268464768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572441.071656:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787572441.071939:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268464768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572441.417989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572441.418058:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572441.418090:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572441.418112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572441.418160:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572441.418196:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244336384 00000100:00100000:3.0:1787572441.418208:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244336384 00000100:00100000:3.0:1787572441.418293:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244336512 00000100:00100000:3.0:1787572441.418297:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244336512 00000100:00100000:3.0:1787572441.418327:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 89 00000100:00100000:3.0:1787572441.418339:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244336384:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572441.418442:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244336384:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 104us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572441.418462:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 89 00000100:00100000:3.0:1787572441.418483:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:3.0:1787572441.418489:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244336512:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572441.418517:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244336512:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572441.418523:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:3.0:1787572441.418546:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244336640 00000100:00100000:3.0:1787572441.418549:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244336640 00000100:00100000:3.0:1787572441.418579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244336256 00000100:00100000:3.0:1787572441.418582:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244336256 00000100:00100000:3.0:1787572441.418606:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 156 00000100:00100000:3.0:1787572441.418612:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244336640:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572441.418676:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244336640:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 64us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572441.418683:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 156 00000100:00100000:3.0:1787572441.418695:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 157 00000100:00100000:3.0:1787572441.418702:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2353:x1874405244336256:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572441.418724:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2353:x1874405244336256:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 23us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572441.418740:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 157 00000100:00080000:3.0:1787572441.418765:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787572441.418771:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572441.418773:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572441.419281:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244336128 00000100:00100000:2.0:1787572441.419288:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244336128 00000100:00100000:2.0:1787572441.419338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 295 00000100:00100000:2.0:1787572441.419348:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244336128:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572441.419393:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244336128:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 48us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572441.419400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 295 00000100:00100000:2.0:1787572441.587080:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572441.587113:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268464896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572441.587204:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572441.588881:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268464896 00000100:00100000:2.0:1787572441.588899:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268464896 00000100:00100000:2.0:1787572441.588982:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787572441.588996:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268464896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572441.589058:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572441.589760:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268464896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 763us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572441.589770:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787572441.601145:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268464896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787572441.918766:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572442.912154:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572442.913372:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244336768 00000100:00100000:0.0:1787572442.913390:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244336768 00000100:00100000:0.0:1787572442.913488:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 135 00000100:00100000:0.0:1787572442.913503:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10231:x1874405244336768:12345-192.168.204.55@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787572442.913909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10231:x1874405244336768:12345-192.168.204.55@tcp:60:lhsmtool_posix.0 Request processed in 407us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572442.913919:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 135 00000100:00100000:2.0:1787572442.922894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572442.923082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244337024 00000100:00100000:1.0:1787572442.923096:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244337024 00000100:00100000:1.0:1787572442.923182:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:1.0:1787572442.923195:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:10231:x1874405244337024:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787572442.925488:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:10231:x1874405244337024:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 2280us (2595us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787572442.925504:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00010000:00010000:1.0:1787572442.931299:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572443.425490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572443.426264:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244337152 00000100:00100000:2.0:1787572443.426278:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244337152 00000100:00100000:2.0:1787572443.426380:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 136 00000100:00100000:2.0:1787572443.426394:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:11040:x1874405244337152:12345-192.168.204.55@tcp:101:lsof.0 00010000:00010000:2.0:1787572443.426430:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572443.426468:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb48 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572443.426545:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572443.426561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572443.426915:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572443.427358:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787572443.427363:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:3.0:1787572443.427564:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1787572443.427811:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572443.427867:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572443.427889:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572443.428154:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:2.0:1787572443.428159:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787572443.428171:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276600, rc 0) 00000100:00100000:2.0:1787572443.428282:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+6:11040:x1874405244337152:12345-192.168.204.55@tcp:101:lsof.0 Request processed in 1889us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572443.428292:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 136 00010000:00010000:3.0:1787572443.951449:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787572444.079553:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787572444.079568:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787572444.080187:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787572444.080196:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787572444.975064:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572445.680389:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268465152:0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.680502:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572445.680596:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268465664:0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.680662:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572445.680699:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572445.680706:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268465280:0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.680731:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572445.680773:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268465152 00000100:00100000:1.0:1787572445.680783:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268465152 00000100:00100000:1.0:1787572445.680853:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268465280 00000100:00100000:1.0:1787572445.680857:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268465280 00000100:00100000:1.0:1787572445.680903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787572445.680913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268465152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.680996:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268465152:12345-0@lo:400:kworker.0 Request processed in 83us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572445.681004:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787572445.681024:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787572445.681031:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268465280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.681059:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268465280:12345-0@lo:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572445.681064:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787572445.681111:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1ef3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268465280:0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.681125:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268465152:0@lo:400:kworker.0 00000100:00100000:3.0:1787572445.682275:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268465024:0@lo:400:kworker.0 00000100:00100000:3.0:1787572445.682359:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572445.682426:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268465536:0@lo:400:kworker.0 00000100:00100000:3.0:1787572445.682456:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572445.682488:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572445.682495:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268465408:0@lo:400:kworker.0 00000100:00100000:3.0:1787572445.682524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572445.682581:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268465664 00000100:00100000:3.0:1787572445.682590:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268465664 00000100:00100000:3.0:1787572445.682696:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268465408 00000100:00100000:3.0:1787572445.682700:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268465408 00000100:00100000:3.0:1787572445.682723:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787572445.682733:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268465664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572445.682791:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268465664:12345-0@lo:400:kworker.0 Request processed in 59us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572445.682799:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787572445.682836:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787572445.682864:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268465408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572445.682904:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268465408:12345-0@lo:400:kworker.0 Request processed in 48us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572445.682909:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787572445.682958:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787572445.682963:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572445.682966:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572445.682997:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268465408:0@lo:400:kworker.0 00000100:00100000:3.0:1787572445.683026:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268465536 00000100:00100000:3.0:1787572445.683030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268465536 00000100:00100000:3.0:1787572445.683066:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787572445.683073:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268465536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572445.683110:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268465536:12345-0@lo:400:kworker.0 Request processed in 38us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572445.683116:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1787572445.683129:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572445.683144:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268465536:0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.685109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268465024 00000100:00100000:1.0:1787572445.685131:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268465024 00000100:00100000:1.0:1787572445.685222:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787572445.685235:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268465024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.685350:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3313:x1874405268465024:12345-0@lo:400:kworker.0 Request processed in 119us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572445.685359:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787572445.685485:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d30d720-8336-413c-aa2f-3c1df9a74652:3313:1874405268465024:0@lo:400:kworker.0 00000100:00100000:1.0:1787572445.685555:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268465664:0@lo:400:kworker.0 00000001:00080000:3.0:1787572445.814031:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:3.0:1787572445.999171:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572446.194406:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268465792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572446.194509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572446.194746:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268465792 00000100:00100000:2.0:1787572446.194758:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268465792 00000100:00100000:2.0:1787572446.194838:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787572446.194853:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268465792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572446.194908:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572446.194979:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268465792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572446.194986:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787572446.195382:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268465792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572446.528412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572446.528464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572446.528504:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572446.528540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572446.528565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572446.528607:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244337536 00000100:00100000:3.0:1787572446.528620:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244337536 00000100:00100000:3.0:1787572446.528736:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244337664 00000100:00100000:3.0:1787572446.528740:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244337664 00000100:00100000:3.0:1787572446.528764:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:3.0:1787572446.528776:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244337536:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572446.528883:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2354:x1874405244337536:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 109us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572446.528891:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:3.0:1787572446.528920:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:3.0:1787572446.528927:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244337664:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572446.528953:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2354:x1874405244337664:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572446.528958:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00080000:3.0:1787572446.528978:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572446.528983:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572446.529341:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244337792 00000100:00100000:2.0:1787572446.529347:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244337792 00000100:00100000:2.0:1787572446.529401:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244337408 00000100:00100000:2.0:1787572446.529405:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244337408 00000100:00100000:2.0:1787572446.529428:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 161 00000100:00100000:2.0:1787572446.529436:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2354:x1874405244337792:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572446.529497:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2354:x1874405244337792:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 62us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572446.529517:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 161 00000100:00100000:2.0:1787572446.529534:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 162 00000100:00100000:2.0:1787572446.529541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2354:x1874405244337408:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572446.529573:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2354:x1874405244337408:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 32us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572446.529579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 162 00000100:00100000:0.0:1787572446.530000:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244337280 00000100:00100000:0.0:1787572446.530006:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244337280 00000100:00100000:0.0:1787572446.530057:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 297 00000100:00100000:0.0:1787572446.530074:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244337280:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572446.530116:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244337280:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 44us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572446.530122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 297 00000100:00080000:3.0:1787572446.533760:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572446.706989:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268465920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572446.707093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572446.708999:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268465920 00000100:00100000:2.0:1787572446.709019:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268465920 00000100:00100000:2.0:1787572446.709122:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787572446.709136:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268465920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572446.709206:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572446.709326:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268465920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572446.709334:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787572446.709893:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268465920:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787572447.024291:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572448.046975:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572449.076554:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787572449.352315:0:12376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:54:05 (1787572445) 00010000:00010000:3.0:1787572450.096658:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572450.800906:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268466432:0@lo:400:kworker.0 00000100:00100000:3.0:1787572450.800978:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572450.801062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787572450.801069:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268466048:0@lo:400:kworker.0 00000100:00100000:3.0:1787572450.801100:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572450.801128:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874405268466560:0@lo:400:kworker.0 00000100:00100000:3.0:1787572450.801153:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572450.801618:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268466304:0@lo:400:kworker.0 00000100:00100000:0.0:1787572450.801676:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572450.801697:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787572450.801703:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268466176:0@lo:400:kworker.0 00000100:00100000:0.0:1787572450.801726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572450.801742:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268466688:0@lo:400:kworker.0 00000100:00100000:0.0:1787572450.801764:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572450.801797:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268466432 00000100:00100000:0.0:1787572450.801804:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268466432 00000100:00100000:0.0:1787572450.801877:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268466688 00000100:00100000:0.0:1787572450.801881:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268466688 00000100:00100000:0.0:1787572450.801905:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787572450.801914:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268466432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572450.801964:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268466432:12345-0@lo:400:kworker.0 Request processed in 51us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572450.801971:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787572450.801988:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787572450.801995:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268466688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572450.802161:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268466688:12345-0@lo:400:kworker.0 Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572450.802234:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787572450.802254:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787572450.802258:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572450.802293:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268466688:0@lo:400:kworker.0 00000100:00100000:3.0:1787572450.802413:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268466432:0@lo:400:kworker.0 00000100:00100000:2.0:1787572450.802536:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268466048 00000100:00100000:2.0:1787572450.802541:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268466048 00000100:00100000:2.0:1787572450.802580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787572450.802589:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3312:x1874405268466048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572450.802629:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3312:x1874405268466048:12345-0@lo:400:kworker.0 Request processed in 41us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572450.802657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787572450.802687:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268466560 00000100:00100000:2.0:1787572450.802691:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268466560 00000100:00100000:2.0:1787572450.802728:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268466304 00000100:00100000:2.0:1787572450.802731:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268466304 00000100:00100000:2.0:1787572450.802744:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268466176 00000100:00100000:2.0:1787572450.802746:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268466176 00000100:00100000:2.0:1787572450.802758:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787572450.802764:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874405268466560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572450.802796:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874405268466560:12345-0@lo:400:kworker.0 Request processed in 32us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572450.802802:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787572450.802814:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787572450.802836:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268466304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572450.802873:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268466304:12345-0@lo:400:kworker.0 Request processed in 53us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572450.802880:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787572450.802893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787572450.802899:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268466176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572450.802926:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268466176:12345-0@lo:400:kworker.0 Request processed in 28us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572450.802932:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1787572450.802954:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572450.802972:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268466176:0@lo:400:kworker.0 00000100:00100000:2.0:1787572450.802984:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268466304:0@lo:400:kworker.0 00000100:00100000:3.0:1787572450.805935:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268466048:0@lo:400:kworker.0 00000100:00100000:3.0:1787572450.805979:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874405268466560:0@lo:400:kworker.0 00000100:00100000:3.0:1787572451.014549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572451.014726:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244338048 00000100:00100000:2.0:1787572451.014736:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244338048 00000100:00100000:2.0:1787572451.014811:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 137 00000100:00100000:2.0:1787572451.014834:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:11307:x1874405244338048:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787572451.014872:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572451.014895:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436c3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.014974:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.014988:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.015014:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.015029:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.015035:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.015041:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787572451.016508:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787572451.016781:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436c52 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.016796:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436c52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.016806:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436c52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572451.016829:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787572451.018174:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018185:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018193:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018199:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572451.018203:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018211:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018227:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d1e1353200) 00010000:00010000:2.0:1787572451.018230:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572451.018235:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018242:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436c44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018255:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018260:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018372:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018394:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572451.018397:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018404:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018412:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98d1c3a46a00) 00010000:00010000:2.0:1787572451.018414:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572451.018417:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018423:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436c4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.018983:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436c3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb4f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.019013:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436c52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb4f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.019022:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:2.0:1787572451.019024:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572451.019027:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276800, rc 0) 00000100:00100000:2.0:1787572451.019117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:11307:x1874405244338048:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 4288us (4570us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787572451.019126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 137 00000100:00100000:0.0:1787572451.029446:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572451.029505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572451.029680:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244338304 00000100:00100000:2.0:1787572451.029702:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244338304 00000100:00100000:2.0:1787572451.029778:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 138 00000100:00100000:2.0:1787572451.029792:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:11307:x1874405244338304:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787572451.029916:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:11307:x1874405244338304:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 Request processed in 129us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572451.029925:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 138 00000100:00100000:3.0:1787572451.031306:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244338176 00000100:00100000:3.0:1787572451.031316:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244338176 00000100:00100000:2.0:1787572451.031460:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:2.0:1787572451.031506:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:2353:x1874405244338176:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572451.031520:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572451.031546:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436c52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb4f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572451.031566:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:2.0:1787572451.031571:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572451.031621:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:2353:x1874405244338176:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 142us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572451.031629:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00010000:00010000:1.0:1787572451.119206:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787572451.246951:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787572451.246966:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572451.247939:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787572451.247956:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787572451.311021:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268466816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572451.311127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572451.311272:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268466816 00000100:00100000:0.0:1787572451.311285:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268466816 00000100:00100000:0.0:1787572451.311363:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787572451.311375:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268466816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787572451.311427:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572451.315538:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268466816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4135us (4380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572451.315558:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787572451.325224:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268466816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572451.648523:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572451.648611:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244338432 00000100:00100000:2.0:1787572451.648624:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244338432 00000100:00100000:2.0:1787572451.648766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 299 00000100:00100000:2.0:1787572451.648778:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244338432:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572451.649355:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2354:x1874405244338432:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 575us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572451.649369:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 299 00000100:00100000:0.0:1787572451.651413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572451.651471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572451.651510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572451.651582:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244338816 00000100:00100000:2.0:1787572451.651585:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244338560 00000100:00100000:3.0:1787572451.651595:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244338816 00000100:00100000:2.0:1787572451.651595:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244338560 00000100:00100000:1.0:1787572451.651661:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244338688 00000100:00100000:1.0:1787572451.651665:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244338688 00000100:00100000:3.0:1787572451.651763:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 166 00000100:00100000:3.0:1787572451.651776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2353:x1874405244338816:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572451.651835:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:2.0:1787572451.651842:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2352:x1874405244338560:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:2.0:1787572451.651867:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436624 00000100:00100000:3.0:1787572451.651873:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2353:x1874405244338816:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 100us (363us total) trans 0 rc 0/0 00000100:00080000:2.0:1787572451.651878:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98d1d0afc000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787572451.651880:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 166 00000001:00000004:2.0:1787572451.651927:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:2.0:1787572451.652250:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+2:2352:x1874405244338560:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 406us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572451.652258:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00010000:00010000:2.0:1787572451.652285:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572451.653028:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:1.0:1787572451.653041:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244338688:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572451.653085:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244338688:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 49us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572451.653092:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00080000:0.0:1787572451.653159:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787572451.653164:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572451.653168:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572451.827663:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d09cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268466944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572451.827757:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572451.827863:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268466944 00000100:00100000:0.0:1787572451.827872:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268466944 00000100:00100000:0.0:1787572451.827945:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787572451.827955:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268466944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572451.828000:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572451.828048:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268466944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572451.828056:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787572451.828105:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d09cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268466944:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787572451.942209:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:1.0:1787572451.942221:0:6719:0:(genops.c:885:class_export_put()) final put ffff98d1d0aff000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:3.0:1787572451.947883:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d0aff000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd for lustre-OST0000 00000020:00000080:3.0:1787572451.947985:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1d0afc000 for lustre-OST0000 00010000:00010000:2.0:1787572452.152017:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572453.166815:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572453.681199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572453.681312:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244338944 00000100:00100000:2.0:1787572453.681326:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244338944 00000100:00100000:2.0:1787572453.681429:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 139 00000100:00100000:2.0:1787572453.681444:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:11349:x1874405244338944:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572453.681485:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572453.681513:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb56 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.681597:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.681616:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.681684:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.681701:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.681708:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.681715:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682088:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682098:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682107:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682115:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572453.682121:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682132:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682148:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:2.0:1787572453.682152:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572453.682158:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682171:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682185:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682191:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682197:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682201:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572453.682205:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682212:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682220:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98d1c3a46f00) 00010000:00010000:2.0:1787572453.682223:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572453.682225:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436c6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682278:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436c60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb56 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682306:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:2.0:1787572453.682308:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572453.682313:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb56 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.682324:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276800, rc 0) 00000100:00100000:2.0:1787572453.682419:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:11349:x1874405244338944:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 979us (1237us total) trans 0 rc 301/301 00000100:00100000:2.0:1787572453.682429:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 139 00000100:00080000:3.0:1787572453.683291:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572453.697139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572453.697189:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244339200 00000100:00100000:3.0:1787572453.697203:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244339200 00000100:00100000:3.0:1787572453.697287:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 140 00000100:00100000:3.0:1787572453.697301:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:11349:x1874405244339200:12345-192.168.204.55@tcp:36:lfs.0 00010000:00010000:3.0:1787572453.697384:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572453.697434:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4365de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db98f expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.700784:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:3.0:1787572453.700802:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572453.701191:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.701744:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.701758:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.701827:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.701849:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 5 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572453.701869:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268467072:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572453.702015:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572453.708910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572453.709017:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268467072:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572453.709055:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572453.710683:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244339328 00000100:00100000:2.0:1787572453.710704:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244339328 00010000:00010000:2.0:1787572453.710793:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 6 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572453.710844:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:2.0:1787572453.710857:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2353:x1874405244339328:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572453.710880:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572453.710888:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 6 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.710904:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 6 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.710936:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb48 expref: 6 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.710971:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:2.0:1787572453.710977:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.710988:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.710997:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.711027:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572453.711110:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244339328:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 256us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572453.711118:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 59 00010000:00010000:2.0:1787572453.711157:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.711166:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.711197:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.711210:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787572453.711864:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787572453.712111:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572453.713944:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787572453.713977:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.713988:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.713997:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.714004:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572453.714009:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.714017:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.714038:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0bb00) 00010000:00010000:2.0:1787572453.714042:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572453.714048:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.714053:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436c75 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787572453.714076:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e9609a9 reply state 00000000762f2040 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572453.714086:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572453.714206:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:11349:x1874405244339200:12345-192.168.204.55@tcp:36:lfs.0 Request processed in 16903us (17077us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787572453.714217:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 140 00010000:00010000:0.0:1787572453.720321:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.720350:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.720360:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.720367:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572453.720373:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.720382:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.720407:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98d1c3a46200) 00010000:00010000:0.0:1787572453.720410:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572453.720416:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.720422:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436c7c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572453.771799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572453.771886:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244339456 00000100:00100000:1.0:1787572453.771903:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244339456 00000100:00100000:1.0:1787572453.771983:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 141 00000100:00100000:1.0:1787572453.772019:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:11357:x1874405244339456:12345-192.168.204.55@tcp:101:lctl.0 00010000:00010000:1.0:1787572453.772056:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572453.772088:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb5d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572453.772178:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572453.772195:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572453.772209:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572453.772315:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787572453.772320:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572453.772352:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572453.772384:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb5d expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572453.772404:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb5d expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572453.772414:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:1.0:1787572453.772429:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572453.772433:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462e00, rc 0) 00000100:00100000:1.0:1787572453.772525:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:11357:x1874405244339456:12345-192.168.204.55@tcp:101:lctl.0 Request processed in 510us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572453.772545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 141 00000100:00100000:0.0:1787572453.885263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572453.885394:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244339584 00000100:00100000:0.0:1787572453.885409:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244339584 00000100:00100000:0.0:1787572453.885499:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 142 00000100:00100000:0.0:1787572453.885514:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+15:11363:x1874405244339584:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572453.885543:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572453.885573:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436c91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.885690:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.885709:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.885739:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.885758:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.885776:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.885784:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.888744:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671600/0x9fe530ef4f436ca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.888803:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671600/0x9fe530ef4f436ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.888820:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671600/0x9fe530ef4f436ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572453.888908:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787572453.888912:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572453.888943:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671600/0x9fe530ef4f436ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.888959:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.888966:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.888973:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.888979:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572453.888984:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.888993:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889005:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:0.0:1787572453.889008:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572453.889012:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436c98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889048:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889055:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889061:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889065:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572453.889069:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889075:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889084:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98d1e1353900) 00010000:00010000:0.0:1787572453.889087:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572453.889090:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889096:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436c9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889144:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436c91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb64 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889159:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671600/0x9fe530ef4f436ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb64 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.889173:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:0.0:1787572453.889176:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787572453.889178:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671600, rc 0) 00000100:00100000:0.0:1787572453.889267:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:11363:x1874405244339584:12345-192.168.204.55@tcp:101:bash.0 Request processed in 3756us (4029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572453.889274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 142 00000100:00100000:1.0:1787572453.893190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572453.893839:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244339840 00000100:00100000:2.0:1787572453.893861:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244339840 00000100:00100000:2.0:1787572453.893940:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 143 00000100:00100000:2.0:1787572453.893953:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+16:11363:x1874405244339840:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572453.893981:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572453.894010:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436cad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb6b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.894198:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.894230:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.894245:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.895129:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.895157:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.895172:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787572453.897305:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787572453.899092:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899114:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899146:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899186:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899194:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899201:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899207:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572453.899211:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899219:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899232:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572453.899235:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572453.899239:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899245:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436cb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787572453.899259:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce8c9ecd reply state 00000000de5b7577 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572453.899269:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787572453.899328:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436cad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899343:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.899351:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572453.899354:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572453.899357:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277400, rc 0) 00000100:00100000:2.0:1787572453.899436:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11363:x1874405244339840:12345-192.168.204.55@tcp:101:bash.0 Request processed in 5485us (6264us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787572453.899446:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 143 00010000:00010000:0.0:1787572453.905595:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.905619:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.905628:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.905655:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572453.905661:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.905669:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.905699:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c3a46f00) 00010000:00010000:0.0:1787572453.905702:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572453.905708:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.905714:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572453.920784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572453.920971:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244339968 00000100:00100000:2.0:1787572453.920984:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244339968 00000100:00100000:2.0:1787572453.921045:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:2.0:1787572453.921057:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874405244339968:12345-192.168.204.55@tcp:8:bash.0 00010000:00080000:2.0:1787572453.921101:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:2.0:1787572453.921142:0:6693:0:(genops.c:1385:class_connect()) connect: client 6d499b5b-e864-4e70-bf3c-7c3a42e124cd, cookie 0x9fe530ef4f436cd0 00002000:00100000:2.0:1787572453.921157:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6d499b5b-e864-4e70-bf3c-7c3a42e124cd/ffff98d1c2daa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787572453.921193:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787572453.921552:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787572453.921600:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98d1c2da8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572453.921754:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2352:x1874405244339968:12345-192.168.204.55@tcp:8:bash.0 Request processed in 696us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572453.921775:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:2.0:1787572453.930300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572453.930347:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244340096 00000100:00100000:2.0:1787572453.930368:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244340096 00000100:00100000:2.0:1787572453.930450:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:2.0:1787572453.930461:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:0:x1874405244340096:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572453.930486:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572453.930514:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb72 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572453.930553:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787572453.930579:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1787572453.930584:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572453.930595:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.930618:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.930652:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276800, rc 0) 00000100:00100000:2.0:1787572453.930722:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:0:x1874405244340096:12345-192.168.204.55@tcp:101:bash.0 Request processed in 262us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572453.930731:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00080000:3.0:1787572453.931437:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572453.947913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572453.964656:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244340224 00000100:00100000:2.0:1787572453.964684:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244340224 00000100:00100000:2.0:1787572453.964790:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:2.0:1787572453.964804:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:11363:x1874405244340224:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572453.964832:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572453.964858:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb79 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.965001:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.965012:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572453.965018:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572453.965024:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.965073:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572453.965090:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 8 pid: 6692 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572453.965108:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1874405268467200:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572453.967342:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4193000 going to sleep for 11 seconds 00000100:00100000:2.0:1787572453.979339:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572453.979494:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1874405268467200:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572453.979539:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572453.979582:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276a00, rc 0) 00000100:00100000:0.0:1787572453.979705:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:11363:x1874405244340224:12345-192.168.204.55@tcp:101:bash.0 Request processed in 14902us (31807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572453.979715:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:3.0:1787572453.980367:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244340352 00000100:00100000:3.0:1787572453.980397:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244340352 00010000:00010000:3.0:1787572453.980452:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 8 pid: 6692 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572453.980504:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:3.0:1787572453.980515:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244340352:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572453.980535:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572453.980568:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 8 pid: 6692 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.980583:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 8 pid: 6692 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.980613:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ef74697/0x9fe530ef4f436cd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb72 expref: 8 pid: 6692 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.980631:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572453.980662:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572453.980674:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.980686:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572453.980753:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572453.980796:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1874405268467328:192.168.204.55@tcp:105: 00000100:00100000:3.0:1787572453.985836:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572453.990148:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc8d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1874405268467328:192.168.204.55@tcp:105: 00010000:00010000:3.0:1787572453.990190:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572453.990290:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244340352:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 9774us (10969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572453.990305:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:0.0:1787572453.995229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572453.996033:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244340608 00000100:00100000:1.0:1787572453.996051:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244340608 00000100:00100000:1.0:1787572453.996138:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:1.0:1787572453.996152:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:11363:x1874405244340608:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:1.0:1787572453.996750:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11363:x1874405244340608:12345-192.168.204.55@tcp:35:bash.0 Request processed in 597us (1543us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787572453.996771:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:1.0:1787572454.178105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572454.178276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244340864 00000100:00100000:0.0:1787572454.178292:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244340864 00000100:00100000:0.0:1787572454.178382:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 144 00000100:00100000:0.0:1787572454.178395:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11373:x1874405244340864:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572454.178448:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572454.178476:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb80 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572454.178697:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787572454.178882:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436ce5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb80 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572454.178901:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:0.0:1787572454.178904:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572454.178910:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670a00/0x9fe530ef4f436ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb80 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572454.178945:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670a00, rc 0) 00000100:00100000:0.0:1787572454.179173:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:11373:x1874405244340864:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 780us (1085us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787572454.179183:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 144 00010000:00010000:2.0:1787572454.191329:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572454.194821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.198241:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244341120 00000100:00100000:1.0:1787572454.198267:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244341120 00000100:00100000:1.0:1787572454.198377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:1.0:1787572454.198391:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:11373:x1874405244341120:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:1.0:1787572454.198848:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:11373:x1874405244341120:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 458us (4044us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787572454.198858:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00000040:00080000:3.0:1787572454.327186:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787572454.327201:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572454.327908:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787572454.327923:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787572454.349969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572454.350062:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244341248 00000100:00100000:2.0:1787572454.350077:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244341248 00000100:00100000:2.0:1787572454.350163:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 145 00000100:00100000:2.0:1787572454.350175:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:11379:x1874405244341248:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572454.350210:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572454.350246:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb87 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.350356:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436cfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.350373:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.350387:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572454.350466:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787572454.350470:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572454.350497:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.350919:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb87 expref: 23 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.351095:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb87 expref: 22 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.351171:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572454.351175:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787572454.351180:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276600, rc 0) 00000100:00100000:2.0:1787572454.351323:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:11379:x1874405244341248:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1149us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572454.351334:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 145 00000100:00100000:0.0:1787572454.362001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572454.362193:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244341504 00000100:00100000:3.0:1787572454.362279:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244341504 00000100:00100000:3.0:1787572454.362357:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 146 00000100:00100000:3.0:1787572454.362372:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:11379:x1874405244341504:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572454.362402:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572454.362432:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.362951:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.362970:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.363007:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572454.363022:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787572454.369617:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb8e expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.369689:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb8e expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.369701:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:3.0:1787572454.369705:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572454.369708:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea400, rc 0) 00000100:00100000:3.0:1787572454.370456:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11379:x1874405244341504:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 8081us (8462us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787572454.370468:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 146 00000100:00100000:3.0:1787572454.379071:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.379464:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244341760 00000100:00100000:1.0:1787572454.379480:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244341760 00000100:00100000:3.0:1787572454.380045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.380217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 147 00000100:00100000:1.0:1787572454.380233:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11379:x1874405244341760:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572454.380279:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572454.380310:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb95 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.380474:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.380495:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.380509:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572454.380538:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787572454.380768:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb95 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.380793:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb95 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.380803:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:1.0:1787572454.380806:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787572454.380811:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462c00, rc 0) 00000100:00100000:1.0:1787572454.380888:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11379:x1874405244341760:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 660us (1831us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787572454.380896:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 147 00000100:00100000:2.0:1787572454.382988:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244341888 00000100:00100000:2.0:1787572454.383009:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244341888 00000100:00100000:2.0:1787572454.383182:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:2.0:1787572454.383195:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:2353:x1874405244341888:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572454.383226:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572454.383261:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb8e expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.383290:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572454.383295:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572454.383365:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:2353:x1874405244341888:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 173us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572454.383373:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1787572454.393329:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572454.395707:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244342016 00000100:00100000:2.0:1787572454.395730:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244342016 00000100:00100000:2.0:1787572454.395839:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:2.0:1787572454.395854:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244342016:12345-192.168.204.55@tcp:1:lfs.0 00010000:00010000:2.0:1787572454.395919:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.395945:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.395956:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572454.395961:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572454.395966:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.396017:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.396054:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 7 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572454.396074:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874405268467456:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572454.396229:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4193300 going to sleep for 11 seconds 00000100:00100000:2.0:1787572454.401966:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874405268467456:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572454.402008:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572454.407173:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572454.407874:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244342144 00000100:00100000:2.0:1787572454.407890:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244342144 00002000:00100000:2.0:1787572454.407964:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98d1f40eea00 x1874405244342144/t0(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:490/0 lens 504/0 e 0 to 0 dl 1787572465 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572454.407978:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f40eea00 with x1874405244342144 ext(0->12) 00010000:00010000:2.0:1787572454.407990:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 8 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.408012:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 8 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572454.408021:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d1f40eea00 00000100:00100000:2.0:1787572454.408072:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:2.0:1787572454.408084:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244342144:12345-192.168.204.55@tcp:4:lfs.0 00000001:00100000:1.0:1787572454.483941:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000100:00100000:2.0:1787572454.485174:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2354:x1874405244342144:12345-192.168.204.55@tcp:4:lfs.0 Request processed in 77076us (78001us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787572454.485191:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00002000:00100000:2.0:1787572454.485218:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98d1f40eea00 x1874405244342144/t4294967305(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:490/0 lens 504/448 e 0 to 0 dl 1787572465 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572454.485230:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f40eea00 with x1874405244342144 ext(0->12) 00010000:00010000:2.0:1787572454.485243:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 9 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.485408:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 9 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572454.485418:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d1f40eea00 00000100:00100000:3.0:1787572454.491139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572454.491246:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244342272 00000100:00100000:2.0:1787572454.491271:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244342272 00010000:00010000:2.0:1787572454.491330:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 9 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572454.491844:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:2.0:1787572454.491860:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2353:x1874405244342272:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572454.491880:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787572454.491911:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787572454.491914:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787572452 00002000:00010000:2.0:1787572454.491917:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787572452 00002000:00010000:2.0:1787572454.491920:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787572452 00010000:00010000:2.0:1787572454.491958:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 9 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.491976:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 9 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.492006:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000686a5010/0x9fe530ef4f436cde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb79 expref: 9 pid: 6693 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.492027:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572454.492032:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572454.492039:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.492050:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.492088:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572454.493700:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244342272:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 1829us (2575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572454.493716:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00010000:00010000:2.0:1787572454.493786:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.493803:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.493875:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.493884:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.493892:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.493900:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572454.493904:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.493913:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.494083:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572454.494094:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017a898c5/0x9fe530ef4f436d2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572454.497090:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244342016:12345-192.168.204.55@tcp:1:lfs.0 Request processed in 101217us (103755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572454.497182:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:0.0:1787572454.502960:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.503077:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244342528 00000100:00100000:1.0:1787572454.503092:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244342528 00000100:00100000:1.0:1787572454.503188:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:1.0:1787572454.503212:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7482050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:11379:x1874405244342528:12345-192.168.204.55@tcp:35:lfs.0 00000004:00010000:1.0:1787572454.503324:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb95 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572454.504036:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787572454.504090:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787572454.506866:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787572454.507329:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.507432:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.507445:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.507622:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.507817:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 29 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572454.507839:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbcab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1874405268467584:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572454.508099:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787572454.513101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572454.513328:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244342656 00000100:00100000:3.0:1787572454.513342:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244342656 00010000:00010000:3.0:1787572454.513421:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 30 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572454.513483:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:3.0:1787572454.513782:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:2353:x1874405244342656:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572454.513805:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572454.513815:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 30 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.513833:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 30 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.513863:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:3.0:1787572454.513870:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.513882:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.513891:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572454.513917:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572454.514100:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:2353:x1874405244342656:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 586us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572454.514116:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 62 00010000:00010000:1.0:1787572454.516079:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb6b expref: 29 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572454.516174:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbcab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1874405268467584:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572454.516269:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.516303:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.516310:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572454.516816:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787572454.517126:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787572454.517296:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbcab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874405268467712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787572454.517400:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572454.517590:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572454.518322:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268467712 00000100:00100000:3.0:1787572454.518334:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268467712 00000100:00100000:3.0:1787572454.518667:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787572454.518683:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874405268467712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787572454.518842:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874405268467712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572454.518873:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787572454.519392:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbcab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874405268467712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787572454.520741:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787572454.520898:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874405268467840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787572454.520987:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572454.521346:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4193b40 going to sleep for 11 seconds 00000100:00080000:0.0:1787572454.521653:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787572454.521887:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268467840 00000100:00100000:3.0:1787572454.521898:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268467840 00000100:00100000:3.0:1787572454.521968:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787572454.521982:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874405268467840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787572454.522483:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1874405268467840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 503us (1495us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787572454.522492:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787572454.522663:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1874405268467840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787572454.522768:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787572454.522828:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.522841:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.522850:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.522857:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572454.522863:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.522871:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.522893:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:1.0:1787572454.522912:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787572454.522919:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.522926:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d32 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787572454.523190:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787572454.523506:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787572454.523704:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384620067330ns, next at 385620063057ns, rc = 0 00000001:00080000:1.0:1787572454.523716:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787572454.523779:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:1.0:1787572454.523782:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787572454.523791:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb95 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572454.523934:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7482050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11379:x1874405244342528:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 20734us (21003us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787572454.523944:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00000020:00080000:1.0:1787572454.523950:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787572454.527242:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.527661:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244342784 00000100:00100000:1.0:1787572454.527678:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244342784 00000100:00100000:1.0:1787572454.527771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 148 00000100:00100000:1.0:1787572454.527785:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11379:x1874405244342784:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572454.527819:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572454.527849:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436d39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbb9c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.527938:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb9c expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.527980:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb9c expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.528009:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572454.528013:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787572454.528017:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463800, rc 0) 00000100:00100000:1.0:1787572454.528095:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:11379:x1874405244342784:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 313us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572454.528103:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 148 00000100:00100000:0.0:1787572454.532894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572454.533004:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244343040 00000100:00100000:2.0:1787572454.533018:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244343040 00000100:00100000:2.0:1787572454.533091:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:2.0:1787572454.533103:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:11379:x1874405244343040:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1787572454.533464:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11379:x1874405244343040:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 361us (586us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787572454.533473:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:0.0:1787572454.698425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.698703:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244343296 00000100:00100000:1.0:1787572454.698718:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244343296 00000100:00100000:1.0:1787572454.698801:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 149 00000100:00100000:1.0:1787572454.698813:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11389:x1874405244343296:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572454.698845:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572454.698872:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbba3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572454.699063:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787572454.699467:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbba3 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.699487:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:1.0:1787572454.699490:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572454.699496:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbba3 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.699625:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462c00, rc 0) 00000100:00100000:1.0:1787572454.699785:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11389:x1874405244343296:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 973us (1376us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787572454.699795:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 149 00000100:00100000:0.0:1787572454.717031:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.717180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244343424 00000100:00100000:1.0:1787572454.717207:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244343424 00000100:00100000:1.0:1787572454.717293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 150 00000100:00100000:1.0:1787572454.717307:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11389:x1874405244343424:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:1.0:1787572454.717437:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717472:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717490:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717510:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717529:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717537:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717723:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717766:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717774:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572454.717833:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717850:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717858:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717867:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717875:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572454.717880:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717891:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717906:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:1.0:1787572454.717910:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572454.717916:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717923:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717953:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717960:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717966:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717972:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572454.717975:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717982:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.717990:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1d0b0b100) 00010000:00010000:1.0:1787572454.717993:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572454.717996:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.718002:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.718020:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.718026:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.718033:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.718046:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572454.718050:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.718056:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.718065:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572454.718068:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572454.718071:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.718077:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572454.718194:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11389:x1874405244343424:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 888us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572454.718204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 150 00000100:00100000:1.0:1787572454.724843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572454.725157:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244343680 00000100:00100000:2.0:1787572454.725172:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244343680 00000100:00100000:2.0:1787572454.725263:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:2.0:1787572454.725277:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11389:x1874405244343680:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1787572454.726080:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:11389:x1874405244343680:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 801us (1251us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787572454.726091:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:0.0:1787572454.796537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.796690:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244343936 00000100:00100000:1.0:1787572454.796704:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244343936 00000100:00100000:1.0:1787572454.796803:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 151 00000100:00100000:1.0:1787572454.796816:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:11392:x1874405244343936:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572454.796850:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572454.796883:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbaa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.796987:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797024:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797038:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797056:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797063:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797070:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797265:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797274:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797282:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572454.797293:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787572454.797425:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797434:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797441:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797455:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572454.797460:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797468:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797484:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:1.0:1787572454.797487:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572454.797492:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797498:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797516:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797522:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797529:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797535:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572454.797538:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797543:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797562:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1d0b0b100) 00010000:00010000:1.0:1787572454.797564:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572454.797567:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797573:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797628:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797709:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.797717:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572454.797720:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787572454.797723:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463e00, rc 0) 00000100:00100000:1.0:1787572454.797829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:11392:x1874405244343936:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1015us (1308us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787572454.797839:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 151 00000100:00100000:3.0:1787572454.802021:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572454.802251:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244344064 00000100:00100000:1.0:1787572454.802266:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244344064 00000100:00100000:1.0:1787572454.802350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 152 00000100:00100000:1.0:1787572454.802365:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:11392:x1874405244344064:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1787572454.802477:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802501:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802535:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802571:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802578:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802586:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802592:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572454.802597:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802605:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802620:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572454.802623:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572454.802628:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572454.802660:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572454.803097:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:11392:x1874405244344064:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 733us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572454.803119:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 152 00000100:00100000:1.0:1787572454.814441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572454.814881:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244344320 00000100:00100000:2.0:1787572454.814898:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244344320 00000100:00100000:2.0:1787572454.814978:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1787572454.814990:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:11392:x1874405244344320:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1787572454.821052:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:11392:x1874405244344320:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 6045us (6608us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787572454.821096:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:0.0:1787572455.170104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572455.170253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244344576 00000100:00100000:1.0:1787572455.170267:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244344576 00000100:00100000:1.0:1787572455.170371:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 153 00000100:00100000:1.0:1787572455.170386:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:11423:x1874405244344576:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:1.0:1787572455.170424:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572455.170454:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbb1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.170604:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.170623:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.170690:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572455.170706:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787572455.170913:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb1 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.170939:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb1 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.170949:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572455.170952:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787572455.170956:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462000, rc 0) 00000100:00100000:1.0:1787572455.171037:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+41:11423:x1874405244344576:12345-192.168.204.55@tcp:101:cat.0 Request processed in 654us (949us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787572455.171071:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 153 00000100:00080000:0.0:1787572455.171152:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572455.176813:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572455.177124:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244344832 00000100:00100000:3.0:1787572455.177138:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244344832 00000100:00100000:3.0:1787572455.177232:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:3.0:1787572455.177245:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+41:11423:x1874405244344832:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:3.0:1787572455.177912:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+42:11423:x1874405244344832:12345-192.168.204.55@tcp:35:cat.0 Request processed in 664us (1111us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787572455.177922:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:2.0:1787572455.183949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572455.184193:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244344960 00000100:00100000:0.0:1787572455.184208:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244344960 00000100:00100000:0.0:1787572455.184297:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:0.0:1787572455.184310:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+42:2355:x1874405244344960:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572455.184333:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572455.184376:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb1 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.184405:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:0.0:1787572455.184430:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572455.185810:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+41:2355:x1874405244344960:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 1488us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572455.185826:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00010000:00010000:2.0:1787572455.214855:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572455.285972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572455.286081:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244345216 00000100:00100000:3.0:1787572455.286096:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244345216 00000100:00100000:3.0:1787572455.286194:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 154 00000100:00100000:3.0:1787572455.286208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+41:11429:x1874405244345216:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:3.0:1787572455.286245:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572455.286250:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787572455.286289:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436cfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb87 expref: 41 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572455.286318:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:3.0:1787572455.286339:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572455.286371:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436da2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbb8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572455.286532:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572455.286548:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572455.286559:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572455.286602:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572455.287350:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 41 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572455.287375:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268467968:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572455.287833:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96300 going to sleep for 11 seconds 00000100:00100000:0.0:1787572455.293228:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268467968:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572455.293275:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572455.295391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572455.295697:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244345344 00000100:00100000:2.0:1787572455.295711:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244345344 00010000:00010000:2.0:1787572455.295781:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 42 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572455.295834:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:2.0:1787572455.295846:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+42:2354:x1874405244345344:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572455.295866:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572455.295875:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 42 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.295889:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 42 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.295918:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbaa expref: 42 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.295951:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:2.0:1787572455.295957:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.295968:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.295976:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.296031:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572455.296111:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+41:2354:x1874405244345344:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 266us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572455.296119:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 63 00010000:00010000:0.0:1787572455.298427:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.298456:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572455.298488:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787572455.298782:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f436da2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.298811:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.298821:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:0.0:1787572455.298824:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787572455.298829:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ebe00, rc 0) 00000100:00100000:0.0:1787572455.298909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+41:11429:x1874405244345216:12345-192.168.204.55@tcp:101:dd.0 Request processed in 12704us (12951us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787572455.298919:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 154 00000100:00100000:3.0:1787572455.303421:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572455.303530:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244345600 00000100:00100000:2.0:1787572455.303545:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244345600 00000100:00100000:2.0:1787572455.303628:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 155 00000100:00100000:2.0:1787572455.303682:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+41:11429:x1874405244345600:12345-192.168.204.55@tcp:36:dd.0 00010000:00010000:2.0:1787572455.304087:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.304112:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.304126:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572455.304192:0:7555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787572455.304223:0:7555:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007974f23e reply state 00000000bf2238d9 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572455.304234:0:7555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572455.304364:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+44:11429:x1874405244345600:12345-192.168.204.55@tcp:36:dd.0 Request processed in 698us (958us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787572455.304373:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 155 00000020:00080000:2.0:1787572455.304380:0:7555:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787572455.306979:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.307003:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.307011:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.307018:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572455.307024:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.307033:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.307070:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:0.0:1787572455.307074:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572455.307080:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572455.307088:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436db7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572455.830812:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572455.831185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244345728 00000100:00100000:1.0:1787572455.831206:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244345728 00000100:00100000:1.0:1787572455.831315:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 156 00000100:00100000:1.0:1787572455.831330:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+43:11444:x1874405244345728:12345-192.168.204.55@tcp:101:stat.0 00010000:00010000:1.0:1787572455.831369:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572455.831401:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436dbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbbf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831496:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831513:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831526:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831546:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831553:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831560:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831757:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831792:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831802:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831850:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.831866:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 44 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572455.831884:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbca9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268468096:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572455.832596:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572455.844960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572455.845054:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244345984 00000100:00100000:3.0:1787572455.845067:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244345984 00000100:00100000:3.0:1787572455.845154:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1787572455.845185:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+45:5594:x1874405244345984:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787572455.845632:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+46:5594:x1874405244345984:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 463us (697us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787572455.846805:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1787572455.853011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572455.853521:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244346112 00000100:00100000:0.0:1787572455.853536:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244346112 00010000:00010000:0.0:1787572455.853598:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 46 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572455.853828:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:1.0:1787572455.853846:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+46:2353:x1874405244346112:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572455.853867:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572455.853877:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 46 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.853893:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 46 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.853925:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572455.853932:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.853961:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.853970:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572455.853995:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572455.854084:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+46:2353:x1874405244346112:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 244us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572455.854092:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00010000:00010000:2.0:1787572455.858596:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436da9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbb8 expref: 45 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572455.858931:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbca9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268468096:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572455.858969:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.858983:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.858989:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572455.859057:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787572455.859064:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572455.859095:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864080:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864144:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864153:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864162:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864515:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572455.864520:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864556:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864578:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572455.864581:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572455.864586:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864592:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864616:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864623:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.864630:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.867071:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572455.867082:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.867096:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.867122:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1d0b0b100) 00010000:00010000:2.0:1787572455.867125:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572455.867131:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.867169:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436dcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.867261:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436dbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbbf expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.867279:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbbf expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572455.867288:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:2.0:1787572455.867290:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572455.867293:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463e00, rc 0) 00000100:00100000:2.0:1787572455.867409:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+44:11444:x1874405244345728:12345-192.168.204.55@tcp:101:stat.0 Request processed in 36080us (36606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572455.867419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 156 00000100:00100000:2.0:1787572455.922360:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572455.922390:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268468224:0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.922486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572455.922571:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787572455.922580:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268468352:0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.922626:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572455.922686:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268468352 00000100:00100000:2.0:1787572455.922696:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268468352 00000100:00100000:2.0:1787572455.922776:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787572455.922787:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268468352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.922852:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268468352:12345-0@lo:400:kworker.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572455.922874:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787572455.922917:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268468224 00000100:00100000:3.0:1787572455.922924:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268468224 00000100:00100000:3.0:1787572455.923318:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787572455.923327:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3312:x1874405268468224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572455.923382:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3312:x1874405268468224:12345-0@lo:400:kworker.0 Request processed in 57us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572455.923390:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787572455.923853:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268468352:0@lo:400:kworker.0 00000100:00100000:3.0:1787572455.924477:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787572455.924488:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572455.924494:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268468480:0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.924500:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268468608:0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.924557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572455.924561:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572455.924619:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268468608 00000100:00100000:2.0:1787572455.924625:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268468608 00000100:00100000:3.0:1787572455.924664:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268468224:0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.924691:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787572455.924702:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874405268468608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572455.924704:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268468480 00000100:00100000:3.0:1787572455.924710:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268468480 00000100:00100000:3.0:1787572455.924772:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787572455.924781:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268468480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.926269:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874405268468608:12345-0@lo:400:kworker.0 Request processed in 1558us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572455.926287:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787572455.926289:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268468480:12345-0@lo:400:kworker.0 Request processed in 1506us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572455.926300:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1787572455.926333:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572455.926371:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268468480:0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.926371:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268468608:0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.926458:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268468736:0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.926495:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572455.926529:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268468736 00000100:00100000:2.0:1787572455.926535:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268468736 00000100:00100000:2.0:1787572455.928948:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787572455.928984:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268468736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572455.929126:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874405268468736:12345-0@lo:400:kworker.0 Request processed in 161us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572455.929135:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787572455.929203:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268468736:0@lo:400:kworker.0 00000100:00080000:3.0:1787572455.937755:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572455.937779:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787572455.937816:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268468864:0@lo:400:kworker.0 00000100:00100000:3.0:1787572455.937957:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572455.938035:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268468864 00000100:00100000:3.0:1787572455.938046:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268468864 00000100:00100000:3.0:1787572455.938121:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787572455.938133:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268468864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572455.938202:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268468864:12345-0@lo:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572455.938210:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1787572455.938232:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787572455.938265:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268468864:0@lo:400:kworker.0 00000100:00100000:1.0:1787572455.992876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572455.996166:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244346368 00000100:00100000:3.0:1787572455.996453:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244346368 00000100:00100000:3.0:1787572455.997100:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 157 00000100:00100000:3.0:1787572455.997116:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+44:11450:x1874405244346368:12345-192.168.204.55@tcp:36:truncate.0 00010000:00010000:3.0:1787572455.997200:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572455.997239:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbbf expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572455.997264:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:3.0:1787572455.997270:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787572455.998887:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.000058:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.000086:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572456.000479:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787572456.000557:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031602207 reply state 00000000ccdebb6b transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572456.000569:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572456.000773:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+46:11450:x1874405244346368:12345-192.168.204.55@tcp:36:truncate.0 Request processed in 3656us (7904us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787572456.000784:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 157 00000020:00080000:2.0:1787572456.000792:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787572456.012011:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.012037:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.012068:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.012075:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572456.012081:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.012089:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.012112:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:0.0:1787572456.012116:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572456.012122:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.012128:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f436dda lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572456.049332:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:1.0:1787572456.049395:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:1.0:1787572456.049473:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000020:00080000:1.0:1787572456.049515:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d1f4193540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787572456.049521:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1f48a1500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d1f41939c0 00000020:00080000:1.0:1787572456.049524:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1f48a1c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d1c50c3c00 00000001:00080000:1.0:1787572456.049552:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000020:00080000:1.0:1787572456.049574:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787572456.049903:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787572456.050521:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787572456.050549:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268468992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787572456.050796:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572456.050907:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268468992 00000100:00100000:0.0:1787572456.050919:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268468992 00000100:00100000:0.0:1787572456.051003:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787572456.051015:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268468992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787572456.051049:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787572456.051088:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c30e4, atime: 0x6a8c30e4, ctime: 0x6a8c30e4, blocks: 0x1 00010000:00010000:0.0:1787572456.051523:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.051560:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1787572456.051565:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572456.051572:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.051590:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.051600:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.051608:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.051632:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787572456.051807:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572456.051822:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.051837:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572456.051844:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.051877:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.051902:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.051911:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f436de1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.051960:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572456.051962:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572456.051965:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787572456.052896:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572456.053515:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1874405268468992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2496us (2721us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787572456.053527:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:3.0:1787572456.053663:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1d0b77100/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787572456.053672:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268468992:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787572456.238864:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572456.256281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572456.256585:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244346496 00000100:00100000:2.0:1787572456.256597:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244346496 00000100:00100000:2.0:1787572456.256683:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 158 00000100:00100000:2.0:1787572456.256695:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:11464:x1874405244346496:12345-192.168.204.55@tcp:101:stat.0 00010000:00010000:2.0:1787572456.256733:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572456.256757:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436de8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbc6 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.256909:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.256926:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.256957:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.256973:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.256980:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.256986:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.258915:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.258929:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.258936:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572456.258978:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787572456.258983:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572456.259005:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259018:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259027:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259046:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259053:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259058:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572456.259063:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259071:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259084:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572456.259087:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572456.259091:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259097:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436def lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259109:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259116:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259122:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259126:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572456.259136:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259142:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259150:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572456.259153:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572456.259155:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259161:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436df6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259215:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436de8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 19 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259230:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 18 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.259239:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:2.0:1787572456.259241:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572456.259248:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276400, rc 0) 00000100:00100000:2.0:1787572456.259333:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:11464:x1874405244346496:12345-192.168.204.55@tcp:101:stat.0 Request processed in 2639us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572456.259342:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 158 00000100:00100000:1.0:1787572456.349323:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572456.355600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244346752 00000100:00100000:0.0:1787572456.355619:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244346752 00000100:00100000:0.0:1787572456.355733:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 159 00000100:00100000:0.0:1787572456.355749:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:11474:x1874405244346752:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572456.355882:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572456.356065:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436e04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbcd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572456.359797:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787572456.360096:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436e04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbcd expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.360114:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:0.0:1787572456.360117:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572456.360124:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f436e04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbcd expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.360137:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670600, rc 0) 00000100:00100000:0.0:1787572456.360224:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11474:x1874405244346752:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 4478us (10911us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787572456.360233:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 159 00000100:00100000:3.0:1787572456.365284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572456.365369:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244347008 00000100:00100000:2.0:1787572456.365379:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244347008 00000100:00100000:2.0:1787572456.365442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:2.0:1787572456.365453:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7481c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11474:x1874405244347008:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1787572456.366455:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7481c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:11474:x1874405244347008:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 1000us (1179us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787572456.366465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:2.0:1787572456.431173:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572456.431200:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268469120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572456.431276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572456.431434:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268469120 00000100:00100000:3.0:1787572456.431444:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268469120 00000100:00100000:3.0:1787572456.431520:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787572456.431529:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268469120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572456.431567:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572456.431624:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268469120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572456.431632:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787572456.431812:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268469120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572456.462357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572456.462623:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244347264 00000100:00100000:1.0:1787572456.462664:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244347264 00000100:00100000:1.0:1787572456.462742:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 160 00000100:00100000:1.0:1787572456.462755:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:11480:x1874405244347264:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1787572456.462784:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572456.462807:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbd4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.462927:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.462943:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 21 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.462967:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.463001:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 21 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.463016:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 21 pid: 7555 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572456.463032:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbcab480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268469248:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572456.463322:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787572456.466954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572456.467079:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbcab480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268469248:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572456.467106:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572456.467267:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244347392 00000100:00100000:2.0:1787572456.467276:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244347392 00010000:00010000:2.0:1787572456.467324:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 22 pid: 7555 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572456.467451:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:2.0:1787572456.467465:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:2353:x1874405244347392:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572456.467554:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572456.467563:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 22 pid: 7555 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.467575:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 22 pid: 7555 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.467600:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbc6 expref: 22 pid: 7555 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.467616:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:2.0:1787572456.467621:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.467701:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.467707:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.467750:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572456.467806:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:2353:x1874405244347392:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 342us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572456.467813:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00010000:00010000:1.0:1787572456.468056:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.468064:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572456.468090:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787572456.468270:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.468287:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.468296:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572456.468299:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787572456.468309:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463e00, rc 0) 00000100:00100000:1.0:1787572456.468349:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:11480:x1874405244347264:12345-192.168.204.55@tcp:101:bash.0 Request processed in 5598us (6007us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787572456.468357:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 160 00000100:00100000:1.0:1787572456.471322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572456.471393:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244347648 00000100:00100000:2.0:1787572456.471401:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244347648 00000100:00100000:2.0:1787572456.471563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 161 00000100:00100000:2.0:1787572456.471572:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:11480:x1874405244347648:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:2.0:1787572456.471865:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.471880:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.471891:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572456.471946:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787572456.471975:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055c5ab10 reply state 00000000fd8ab4a2 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572456.471985:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572456.472072:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11480:x1874405244347648:12345-192.168.204.55@tcp:36:bash.0 Request processed in 500us (756us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787572456.472096:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 161 00000020:00080000:2.0:1787572456.472101:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787572456.475043:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.475074:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.475082:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.475089:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572456.475093:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.475158:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.475178:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572456.475181:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572456.475186:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.475193:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436e27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572456.478813:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572456.479472:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244347776 00000100:00100000:2.0:1787572456.479491:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244347776 00000100:00100000:2.0:1787572456.479586:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 162 00000100:00100000:2.0:1787572456.479597:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:11480:x1874405244347776:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572456.479620:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572456.479673:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436e2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbdb expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.479773:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.479789:0:7555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.479798:0:7555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.479836:0:7555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.479849:0:7555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 24 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572456.479863:0:7555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7555:1874405268469376:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572456.479954:0:7555:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63180 going to sleep for 11 seconds 00000100:00100000:0.0:1787572456.483265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572456.483336:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244347904 00000100:00100000:1.0:1787572456.483345:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244347904 00010000:00010000:1.0:1787572456.483397:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 25 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572456.483438:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:1.0:1787572456.483448:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:2353:x1874405244347904:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572456.483462:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572456.483469:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 25 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.483493:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 25 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.483518:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572456.483524:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.483532:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.483539:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.483558:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572456.483616:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:2353:x1874405244347904:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 169us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572456.483624:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 66 00010000:00010000:2.0:1787572456.483970:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f436e19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbd4 expref: 24 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572456.483990:0:7555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7555:1874405268469376:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572456.484011:0:7555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.484021:0:7555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.484027:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572456.484072:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787572456.484077:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572456.484097:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.484127:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436e2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbdb expref: 24 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.484143:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbdb expref: 23 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.484150:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:2.0:1787572456.484153:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572456.484156:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276600, rc 0) 00000100:00100000:2.0:1787572456.484235:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:11480:x1874405244347776:12345-192.168.204.55@tcp:101:bash.0 Request processed in 4640us (5429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572456.484242:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 162 00000100:00100000:0.0:1787572456.492311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572456.492398:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244348160 00000100:00100000:1.0:1787572456.492408:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244348160 00000100:00100000:1.0:1787572456.492467:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:1.0:1787572456.492574:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:11480:x1874405244348160:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:1.0:1787572456.492826:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11480:x1874405244348160:12345-192.168.204.55@tcp:35:bash.0 Request processed in 253us (523us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787572456.500688:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:0.0:1787572456.665761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572456.665857:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244348416 00000100:00100000:2.0:1787572456.665867:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244348416 00000100:00100000:2.0:1787572456.665931:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 163 00000100:00100000:2.0:1787572456.665948:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11490:x1874405244348416:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572456.665974:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572456.665997:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbe2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572456.666255:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787572456.666436:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436e3c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbe2 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.666450:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:2.0:1787572456.666453:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787572456.666458:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbe2 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.666473:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276400, rc 0) 00000100:00100000:2.0:1787572456.666540:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:11490:x1874405244348416:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 594us (790us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787572456.666547:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 163 00000100:00100000:3.0:1787572456.670559:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572456.670897:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244348544 00000100:00100000:1.0:1787572456.670909:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244348544 00000100:00100000:1.0:1787572456.671180:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 164 00000100:00100000:1.0:1787572456.671303:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:11490:x1874405244348544:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:1.0:1787572456.671382:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.671400:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.671412:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.671428:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.671435:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572456.671442:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672746:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672761:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672770:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787572456.672817:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672845:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672852:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672859:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672866:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572456.672871:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672879:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672892:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:0.0:1787572456.672895:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572456.672899:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672905:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672918:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672924:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672930:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672942:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572456.672945:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672950:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672958:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1d0b0bf00) 00010000:00010000:0.0:1787572456.672960:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572456.672963:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672968:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436e51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672983:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672988:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672994:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.672999:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572456.673002:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.673008:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.673026:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:0.0:1787572456.673028:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572456.673032:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.673038:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572456.673234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:11490:x1874405244348544:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 2039us (2755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572456.673243:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 164 00000100:00100000:3.0:1787572456.680256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572456.680586:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244348800 00000100:00100000:2.0:1787572456.680597:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244348800 00000100:00100000:2.0:1787572456.680695:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:2.0:1787572456.680720:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:11490:x1874405244348800:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1787572456.681233:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11490:x1874405244348800:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 526us (987us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787572456.681251:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:3.0:1787572456.760689:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572456.762392:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244349056 00000100:00100000:2.0:1787572456.762406:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244349056 00000100:00100000:2.0:1787572456.762484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 165 00000100:00100000:2.0:1787572456.762497:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11493:x1874405244349056:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572456.762523:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572456.762547:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436e5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbe9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.762626:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.762685:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.762697:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.762724:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.762730:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.762737:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763347:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763369:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763435:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572456.763447:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787572456.763558:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763565:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763571:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763577:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572456.763581:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763587:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763598:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572456.763601:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572456.763605:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763611:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436e66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763622:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763726:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763734:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763738:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572456.763741:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763747:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572456.763756:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572456.763758:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763764:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763808:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436e5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbe9 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763823:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbe9 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572456.763830:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:2.0:1787572456.763833:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572456.763842:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276800, rc 0) 00000100:00100000:2.0:1787572456.763917:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:11493:x1874405244349056:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1422us (3237us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787572456.763926:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 165 00000100:00100000:3.0:1787572456.766784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572456.766885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572456.766912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572456.766938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572456.766967:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244349312 00000100:00100000:3.0:1787572456.766976:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244349312 00000100:00100000:3.0:1787572456.767032:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244349440 00000100:00100000:3.0:1787572456.767035:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244349440 00000100:00100000:3.0:1787572456.767059:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:3.0:1787572456.767069:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244349312:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572456.767490:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244349312:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 420us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572456.767499:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:3.0:1787572456.767532:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:3.0:1787572456.767539:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244349440:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572456.767568:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244349440:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572456.767574:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:3.0:1787572456.767598:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244349568 00000100:00100000:3.0:1787572456.767603:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244349568 00000100:00100000:3.0:1787572456.767674:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 170 00000100:00100000:3.0:1787572456.767683:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244349568:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572456.767727:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2354:x1874405244349568:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 45us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572456.767733:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 170 00000100:00080000:1.0:1787572456.767958:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787572456.767965:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787572456.767967:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572456.768653:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244349184 00000100:00100000:2.0:1787572456.768661:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244349184 00000100:00100000:2.0:1787572456.768701:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 301 00000100:00100000:2.0:1787572456.768721:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244349184:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572456.768761:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eb4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244349184:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 52us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572456.768768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 301 00000100:00100000:1.0:1787572456.775499:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572456.775821:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244349696 00000100:00100000:3.0:1787572456.775832:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244349696 00000100:00100000:3.0:1787572456.775901:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1787572456.775914:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:2355:x1874405244349696:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572456.775933:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572456.775967:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbe9 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572456.775990:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:3.0:1787572456.775996:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572456.776073:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:2355:x1874405244349696:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 161us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572456.776080:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:1.0:1787572456.777493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572456.777691:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244349824 00000100:00100000:0.0:1787572456.777703:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244349824 00000100:00100000:0.0:1787572456.777798:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 166 00000100:00100000:0.0:1787572456.777811:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:11493:x1874405244349824:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:0.0:1787572456.778003:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778029:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778044:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778086:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778093:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778126:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778133:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572456.778139:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778147:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778494:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:0.0:1787572456.778498:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572456.778505:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572456.778512:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572456.778620:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:11493:x1874405244349824:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 809us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572456.778630:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 166 00000100:00100000:0.0:1787572456.784189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572456.784552:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244350080 00000100:00100000:1.0:1787572456.784570:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244350080 00000100:00100000:1.0:1787572456.784694:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:1.0:1787572456.785332:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:11493:x1874405244350080:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:1.0:1787572456.785869:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:11493:x1874405244350080:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 1151us (1701us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787572456.785879:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:2.0:1787572456.945589:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268469504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572456.945745:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572456.946374:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268469504 00000100:00100000:1.0:1787572456.946387:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268469504 00000100:00100000:1.0:1787572456.946449:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787572456.946462:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268469504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787572456.946520:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572456.946594:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268469504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572456.946605:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787572456.946766:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268469504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572457.036940:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.037047:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244350336 00000100:00100000:3.0:1787572457.037057:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244350336 00000100:00100000:3.0:1787572457.037264:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 167 00000100:00100000:3.0:1787572457.037276:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:11511:x1874405244350336:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:3.0:1787572457.037303:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572457.037325:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436e89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbf0 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.037445:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436e90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.037461:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.037475:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572457.037486:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787572457.037668:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436e89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbf0 expref: 31 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.037691:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbf0 expref: 30 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.037712:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:3.0:1787572457.037716:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787572457.037720:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea800, rc 0) 00000100:00100000:3.0:1787572457.037853:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:11511:x1874405244350336:12345-192.168.204.55@tcp:101:cat.0 Request processed in 579us (923us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787572457.037879:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 167 00000100:00080000:1.0:1787572457.037935:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572457.073016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572457.073445:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244350464 00000100:00100000:2.0:1787572457.073461:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244350464 00000100:00100000:2.0:1787572457.073553:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 168 00000100:00100000:2.0:1787572457.073567:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:11512:x1874405244350464:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572457.073602:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572457.073676:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.073798:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436ea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.073815:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.073829:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572457.074133:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787572457.074139:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572457.074223:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.074261:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbf7 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.074281:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbf7 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.074291:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572457.074294:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787572457.074298:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276a00, rc 0) 00000100:00100000:2.0:1787572457.074389:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11512:x1874405244350464:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 825us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572457.074397:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 168 00000100:00100000:2.0:1787572457.078982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.079112:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244350848 00000100:00100000:3.0:1787572457.079127:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244350848 00000100:00100000:3.0:1787572457.079218:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1787572457.079231:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11512:x1874405244350848:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1787572457.080105:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11512:x1874405244350848:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 872us (1134us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787572457.080117:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1787572457.091086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572457.095622:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244350976 00000100:00100000:2.0:1787572457.095761:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244350976 00000100:00100000:2.0:1787572457.095961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:2.0:1787572457.095976:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11512:x1874405244350976:12345-192.168.204.55@tcp:103:lfs.0 00010000:00010000:2.0:1787572457.095997:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787572457.096037:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436e35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbdb expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.096066:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbf0 expref: 31 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.096104:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f436d39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb9c expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.096119:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1d0b0b500) 00010000:00010000:2.0:1787572457.096132:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572457.096247:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:11512:x1874405244350976:12345-192.168.204.55@tcp:103:lfs.0 Request processed in 274us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572457.096266:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:1.0:1787572457.110585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.118843:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244351104 00000100:00100000:0.0:1787572457.118866:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244351104 00000100:00100000:0.0:1787572457.118972:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 169 00000100:00100000:0.0:1787572457.118986:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:11512:x1874405244351104:12345-192.168.204.55@tcp:58:lfs.0 00010000:00010000:0.0:1787572457.119177:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.119211:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.119225:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787572457.119939:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787572457.120522:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:11512:x1874405244351104:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 1532us (9945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.120535:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 169 00000100:00100000:1.0:1787572457.156065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572457.156375:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244351232 00000100:00100000:2.0:1787572457.156389:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244351232 00000100:00100000:2.0:1787572457.156482:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 170 00000100:00100000:2.0:1787572457.156495:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:11514:x1874405244351232:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572457.156525:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572457.156554:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436eb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbbfe expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.156741:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.156759:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.156773:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.156790:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.156809:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.156816:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157625:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157680:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157691:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572457.157755:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787572457.157761:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572457.157783:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157797:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157807:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157814:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157821:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157840:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572457.157846:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157854:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157870:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572457.157874:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572457.157879:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157885:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436eba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157901:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157907:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157914:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.157920:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572457.157922:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.158632:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.158812:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572457.158815:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572457.158821:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.158827:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f436ec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.158896:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f436eb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.158913:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.158921:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:2.0:1787572457.158923:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787572457.158926:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276400, rc 0) 00000100:00100000:2.0:1787572457.160723:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:11514:x1874405244351232:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 4205us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572457.160740:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 170 00010000:00010000:1.0:1787572457.263026:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787572457.392033:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787572457.392047:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787572457.392109:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787572457.392118:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787572457.392292:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268469632:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787572457.392499:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572457.398158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572457.398294:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244351360 00000100:00100000:2.0:1787572457.398308:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244351360 00000100:00100000:2.0:1787572457.398389:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 171 00000100:00100000:2.0:1787572457.398403:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11525:x1874405244351360:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787572457.398447:0:7555:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787572457.398592:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11525:x1874405244351360:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 192us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572457.398614:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 171 00000100:00100000:0.0:1787572457.399520:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268469632:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787572457.405370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.405484:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244351488 00000100:00100000:0.0:1787572457.405498:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244351488 00000100:00100000:0.0:1787572457.405583:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 172 00000100:00100000:0.0:1787572457.405596:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:11525:x1874405244351488:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787572457.405731:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405752:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405765:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405802:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405810:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405817:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405863:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405873:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405880:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572457.405931:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787572457.405936:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572457.405954:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405966:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405973:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405981:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.405999:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572457.406004:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406014:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406028:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:0.0:1787572457.406032:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572457.406038:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406044:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436ecf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406059:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406066:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406072:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406077:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572457.406080:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406086:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406105:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff98d1e1353d00) 00010000:00010000:0.0:1787572457.406108:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572457.406111:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406117:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436ed6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406134:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406155:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406162:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406168:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572457.406170:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406177:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406184:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:0.0:1787572457.406187:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572457.406190:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.406196:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436edd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572457.406301:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:11525:x1874405244351488:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 707us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.406310:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 172 00000100:00100000:1.0:1787572457.417795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572457.417863:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244351744 00000100:00100000:1.0:1787572457.417876:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244351744 00000100:00100000:1.0:1787572457.417952:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 173 00000100:00100000:1.0:1787572457.417965:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+30:11525:x1874405244351744:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572457.418017:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572457.418047:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436ee4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc05 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418220:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418239:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418253:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572457.418268:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787572457.418402:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418410:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418417:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418423:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572457.418428:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418436:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418451:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:1.0:1787572457.418460:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572457.418467:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418473:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f436eeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418529:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436ee4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc05 expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418540:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:1.0:1787572457.418542:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572457.418546:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436ee4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc05 expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.418556:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462000, rc 0) 00000100:00100000:1.0:1787572457.418676:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11525:x1874405244351744:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 673us (856us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787572457.418685:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 173 00000100:00100000:1.0:1787572457.430794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.430991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244351872 00000100:00100000:0.0:1787572457.431005:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244351872 00000100:00100000:0.0:1787572457.431084:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 174 00000100:00100000:0.0:1787572457.431097:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11525:x1874405244351872:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787572457.431170:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787572457.431350:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11525:x1874405244351872:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 253us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.431360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 174 00000100:00100000:1.0:1787572457.437497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.437687:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244352128 00000100:00100000:3.0:1787572457.437712:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244352128 00000100:00100000:3.0:1787572457.437795:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 175 00000100:00100000:3.0:1787572457.437808:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11525:x1874405244352128:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572457.437838:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572457.437842:0:7555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787572457.437892:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436ea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbf7 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.437918:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:3.0:1787572457.437925:0:7555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572457.437943:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436ef9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc0c expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787572457.446946:0:7555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787572457.447460:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f436f00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.447490:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f436f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.447505:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f436f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.447593:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436ef9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc0c expref: 33 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.447617:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f436f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc0c expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.447627:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1c577cc00) 00010000:00010000:3.0:1787572457.447630:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572457.447670:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea600, rc 0) 00000100:00100000:3.0:1787572457.447792:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11525:x1874405244352128:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 9985us (10309us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787572457.447803:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 175 00000100:00100000:3.0:1787572457.452611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.456349:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244352384 00000100:00100000:0.0:1787572457.456366:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244352384 00000100:00100000:0.0:1787572457.456556:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 176 00000100:00100000:0.0:1787572457.456568:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11525:x1874405244352384:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787572457.456680:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572457.456728:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f436f00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc0c expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.456749:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1c577cc00) 00010000:00010000:0.0:1787572457.456762:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572457.456790:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.456806:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.456831:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.456856:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.456863:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.456870:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457190:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457199:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457206:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457212:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572457.457218:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457227:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457236:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:0.0:1787572457.457239:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572457.457243:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457254:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671e00/0x9fe530ef4f436f0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457263:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457269:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457275:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457279:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572457.457282:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457289:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457297:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xec38db92 (ffff98d1e1353d00) 00010000:00010000:0.0:1787572457.457300:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572457.457302:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.457308:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xec38db92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572457.457436:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11525:x1874405244352384:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 868us (4838us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787572457.457444:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 176 00000100:00100000:2.0:1787572457.464068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.464189:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244352512 00000100:00100000:0.0:1787572457.464205:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244352512 00000100:00100000:0.0:1787572457.464282:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 177 00000100:00100000:0.0:1787572457.464296:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11525:x1874405244352512:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572457.464328:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572457.464362:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436f1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc13 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.465121:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.465261:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.465278:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.465437:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.465461:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.465471:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:0.0:1787572457.465474:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787572457.465478:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671400, rc 0) 00000100:00100000:0.0:1787572457.465576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11525:x1874405244352512:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1283us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.465586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 177 00000100:00100000:2.0:1787572457.468990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.469552:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244352768 00000100:00100000:3.0:1787572457.469566:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244352768 00000100:00100000:3.0:1787572457.469679:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 178 00000100:00100000:3.0:1787572457.469707:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11525:x1874405244352768:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787572457.469824:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.469913:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.469949:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787572457.471447:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787572457.471468:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387567832440ns, next at 388567828548ns, rc = 0 00000004:00010000:3.0:1787572457.471607:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b957574 reply state 00000000b55cb8d1 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.471621:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787572457.471813:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11525:x1874405244352768:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 2118us (2833us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787572457.471823:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 178 00000100:00100000:2.0:1787572457.477497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:0.0:1787572457.477744:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.477762:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.477772:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.477779:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572457.477785:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.477792:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.477816:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:0.0:1787572457.477819:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787572457.477825:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.477831:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f436f2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.479099:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244352896 00000100:00100000:3.0:1787572457.479118:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244352896 00000100:00100000:3.0:1787572457.479201:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 179 00000100:00100000:3.0:1787572457.479213:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+33:11525:x1874405244352896:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572457.479243:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572457.479267:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc1a expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.479349:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 34 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.479366:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 34 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.479389:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:3.0:1787572457.479400:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572457.479404:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb200, rc 0) 00000100:00100000:3.0:1787572457.479497:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11525:x1874405244352896:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 285us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572457.479505:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 179 00000100:00100000:0.0:1787572457.491385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.491551:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244353024 00000100:00100000:3.0:1787572457.491565:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244353024 00000100:00100000:3.0:1787572457.491675:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:3.0:1787572457.491689:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+6:2353:x1874405244353024:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787572457.492192:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244353024:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 494us (812us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787572457.492203:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:3.0:1787572457.500460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572457.501525:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244353280 00000100:00100000:1.0:1787572457.501544:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244353280 00000100:00100000:1.0:1787572457.501653:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:1.0:1787572457.501668:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11525:x1874405244353280:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787572457.503325:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11525:x1874405244353280:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1646us (2868us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787572457.503339:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:2.0:1787572457.510106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.510433:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244353536 00000100:00100000:3.0:1787572457.510447:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244353536 00000100:00100000:3.0:1787572457.510527:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 180 00000100:00100000:3.0:1787572457.510540:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11525:x1874405244353536:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787572457.511839:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11525:x1874405244353536:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 1289us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572457.511929:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 180 00000100:00100000:1.0:1787572457.515807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.516028:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244353664 00000100:00100000:3.0:1787572457.516042:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244353664 00000100:00100000:3.0:1787572457.516122:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 181 00000100:00100000:3.0:1787572457.516135:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11525:x1874405244353664:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572457.516301:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572457.516330:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc21 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.516983:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.517006:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.517020:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572457.517073:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572457.517099:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.517134:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc21 expref: 37 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.518992:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc21 expref: 36 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.519005:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:3.0:1787572457.519008:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787572457.519013:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ebe00, rc 0) 00000100:00100000:3.0:1787572457.519119:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:11525:x1874405244353664:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 2984us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572457.519130:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 181 00000100:00100000:3.0:1787572457.531007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.531201:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244353792 00000100:00100000:0.0:1787572457.531217:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244353792 00000100:00100000:0.0:1787572457.531293:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:0.0:1787572457.531308:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244353792:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572457.531360:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572457.531390:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc28 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787572457.531438:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c30e7, blocks: 0x1 00010000:00010000:0.0:1787572457.531466:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:0.0:1787572457.531472:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572457.531484:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.531503:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.531519:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670200, rc 0) 00000100:00100000:0.0:1787572457.531593:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244353792:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 287us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.531601:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:3.0:1787572457.535034:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.535285:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244354048 00000100:00100000:0.0:1787572457.535297:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244354048 00000100:00100000:0.0:1787572457.535369:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 182 00000100:00100000:0.0:1787572457.535382:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:11525:x1874405244354048:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787572457.535552:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:11525:x1874405244354048:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 171us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.535561:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 182 00000100:00100000:0.0:1787572457.547955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.551672:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244354176 00000100:00100000:3.0:1787572457.551720:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244354176 00000100:00100000:1.0:1787572457.552345:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:1.0:1787572457.552361:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:11525:x1874405244354176:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572457.552396:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572457.552435:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc2f expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.552481:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.552490:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572457.552495:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572457.552500:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 9 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.552550:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.552566:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 9 pid: 6693 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572457.552583:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268469760:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572457.552757:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572457.559831:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3817480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268469760:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572457.559901:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 9 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.559938:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462a00, rc 0) 00000100:00100000:3.0:1787572457.560031:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:11525:x1874405244354176:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 7673us (12088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572457.560041:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:1.0:1787572457.560659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.563129:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244354304 00000100:00100000:3.0:1787572457.563168:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244354304 00010000:00010000:3.0:1787572457.563242:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 9 pid: 6693 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.563319:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:3.0:1787572457.563332:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2353:x1874405244354304:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572457.563353:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572457.563388:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 9 pid: 6693 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.563418:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 9 pid: 6693 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.563447:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f436f46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc28 expref: 9 pid: 6693 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.563480:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572457.563484:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572457.563494:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 8 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.563504:0:7642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 8 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.563557:0:7642:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 8 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.563573:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f415b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7642:1874405268469888:192.168.204.55@tcp:105: 00000100:00100000:3.0:1787572457.563731:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96180 going to sleep for 11 seconds 00000100:00100000:3.0:1787572457.574282:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f415b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7642:1874405268469888:192.168.204.55@tcp:105: 00010000:00010000:3.0:1787572457.574327:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572457.574433:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244354304:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 11102us (13799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572457.574447:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:1.0:1787572457.579917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572457.580119:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244354432 00000100:00100000:2.0:1787572457.580134:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244354432 00002000:00100000:2.0:1787572457.580225:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98d1f3815500 x1874405244354432/t0(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:493/0 lens 504/0 e 0 to 0 dl 1787572468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572457.580240:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f3815500 with x1874405244354432 ext(0->8) 00002000:00010000:2.0:1787572457.580249:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f3815500 00000100:00100000:2.0:1787572457.580292:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:2.0:1787572457.580307:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244354432:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787572457.581078:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:2354:x1874405244354432:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 Request processed in 770us (1174us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787572457.581089:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00002000:00100000:2.0:1787572457.581099:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98d1f3815500 x1874405244354432/t4294967314(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:493/0 lens 504/448 e 0 to 0 dl 1787572468 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572457.581109:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f3815500 with x1874405244354432 ext(0->8) 00002000:00010000:2.0:1787572457.581115:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f3815500 00000100:00100000:3.0:1787572457.611149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572457.612146:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244354560 00000100:00100000:1.0:1787572457.612164:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244354560 00000100:00100000:1.0:1787572457.612258:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 183 00000100:00100000:1.0:1787572457.612272:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:11525:x1874405244354560:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787572457.735618:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:11525:x1874405244354560:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 123339us (124482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.735655:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 183 00000001:00080000:3.0:1787572457.736615:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1787572457.736679:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1787572457.736730:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:3.0:1787572457.737892:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268470016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787572457.737971:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572457.738153:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268470016 00000100:00100000:3.0:1787572457.738161:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268470016 00000100:00100000:3.0:1787572457.738223:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787572457.738233:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268470016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787572457.738747:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787572457.738752:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787572455 00002000:00010000:3.0:1787572457.738754:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787572457.738756:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787572455 -> 1787572455 00002000:00010000:3.0:1787572457.738758:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787572457.738802:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268470016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 570us (830us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787572457.738810:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:3.0:1787572457.738856:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1fbd14380/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787572457.738862:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268470016:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1787572457.738999:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787572457.739011:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787572457.739762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00080000:1.0:1787572457.739786:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787572457.740055:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244354688 00000100:00100000:3.0:1787572457.740061:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244354688 00000100:00100000:3.0:1787572457.740131:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:3.0:1787572457.740147:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f41e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:2354:x1874405244354688:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787572457.811102:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1787572457.811210:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1787572457.811481:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f41e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244354688:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 71334us (71715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.811494:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:1.0:1787572457.816556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572457.816756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244354944 00000100:00100000:2.0:1787572457.816773:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244354944 00000100:00100000:2.0:1787572457.816835:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 184 00000100:00100000:2.0:1787572457.816847:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:11525:x1874405244354944:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787572457.816903:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572457.816932:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f436f3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc21 expref: 18 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.816950:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:2.0:1787572457.816955:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787572457.816987:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.817000:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.817010:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787572457.817762:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c543b0e2 reply state 00000000251b8c6c transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572457.817774:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572457.817875:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11525:x1874405244354944:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 1031us (1326us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787572457.817883:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 184 00010000:00010000:2.0:1787572457.823341:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.823357:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.823390:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.823402:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572457.823407:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.823414:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.823432:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:2.0:1787572457.823435:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572457.823439:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.823444:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436f54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572457.825826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572457.826064:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244355072 00000100:00100000:2.0:1787572457.826075:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244355072 00000100:00100000:2.0:1787572457.826149:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:2.0:1787572457.826197:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244355072:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787572457.826467:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787572457.826471:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787572455 -> 1787572454 00002000:00010000:2.0:1787572457.826474:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787572452 00002000:00010000:2.0:1787572457.826476:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787572455 -> 1787572454 00002000:00010000:2.0:1787572457.826478:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787572457.826538:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2355:x1874405244355072:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 344us (722us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787572457.833105:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:0.0:1787572457.837780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.838739:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244355328 00000100:00100000:3.0:1787572457.838754:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244355328 00000100:00100000:3.0:1787572457.838812:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 185 00000100:00100000:3.0:1787572457.838825:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:11525:x1874405244355328:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787572457.838897:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.838916:0:7555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.838938:0:7555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.838976:0:7555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.838994:0:7555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 18 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.839010:0:7555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4158000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7555:1874405268470144:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572457.839180:0:7555:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e12ca900 going to sleep for 11 seconds 00000100:00100000:1.0:1787572457.847115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.848752:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244355456 00000100:00100000:3.0:1787572457.848765:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244355456 00010000:00010000:3.0:1787572457.848816:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 19 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.848857:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:3.0:1787572457.848869:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:2353:x1874405244355456:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572457.848887:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572457.848895:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 19 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.848909:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 19 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.848945:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:3.0:1787572457.848963:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.848972:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.848980:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.849004:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572457.849066:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:2353:x1874405244355456:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 199us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572457.849075:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 68 00010000:00010000:3.0:1787572457.850339:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f436f23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc13 expref: 18 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.850360:0:7555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4158000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7555:1874405268470144:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572457.850542:0:7555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850554:0:7555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850560:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850593:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850601:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850623:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850631:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572457.850656:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850667:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850682:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:3.0:1787572457.850697:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787572457.850702:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.850709:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.850782:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:11525:x1874405244355328:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 Request processed in 11960us (13010us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787572457.850793:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 185 00000100:00100000:1.0:1787572457.854112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.854214:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244355584 00000100:00100000:3.0:1787572457.854236:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244355584 00000100:00100000:3.0:1787572457.854300:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:3.0:1787572457.854312:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244355584:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787572457.854361:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.854380:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 8 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.854403:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572457.854408:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572457.854412:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.854448:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 8 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.854461:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 8 pid: 12010 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.854475:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4158000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268470272:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572457.854630:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e12ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572457.857386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.857581:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4158000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268470272:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572457.857604:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572457.857616:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244355712 00000100:00100000:2.0:1787572457.857625:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244355712 00010000:00010000:2.0:1787572457.857681:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 9 pid: 12010 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572457.857730:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:2.0:1787572457.857742:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2354:x1874405244355712:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572457.857758:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572457.857780:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 9 pid: 12010 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.857794:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 9 pid: 12010 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.857815:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c292ee49/0x9fe530ef4f436f4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc2f expref: 9 pid: 12010 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.857829:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572457.857834:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572457.857839:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.858945:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572457.859008:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572457.859077:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244355712:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 1336us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572457.859087:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 69 00010000:00010000:0.0:1787572457.859387:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.859398:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.859431:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.859440:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.859449:0:12010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.859468:0:12010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572457.859473:0:12010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.859483:0:12010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.859500:0:12010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.859508:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f436f62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572457.859574:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244355584:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 5264us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.859583:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:0.0:1787572457.869769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572457.869935:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244355968 00000100:00100000:1.0:1787572457.869945:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244355968 00000100:00100000:1.0:1787572457.870040:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 186 00000100:00100000:1.0:1787572457.870054:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+17:11525:x1874405244355968:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787572457.870152:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.870169:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.870181:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.870570:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.870584:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 18 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.870593:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.870665:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 18 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.870678:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 18 pid: 7555 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572457.870706:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268470400:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572457.870785:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787572457.873936:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572457.873955:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268470400:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572457.873983:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572457.874141:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244356096 00000100:00100000:3.0:1787572457.874149:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244356096 00010000:00010000:3.0:1787572457.874187:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 19 pid: 7555 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572457.874277:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:1.0:1787572457.874290:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:2354:x1874405244356096:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572457.874306:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572457.874315:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 19 pid: 7555 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.874329:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 19 pid: 7555 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.874352:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f436f31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc1a expref: 19 pid: 7555 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.874365:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:1.0:1787572457.874376:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.874386:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.874393:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.874424:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572457.874469:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.874477:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572457.874480:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:2354:x1874405244356096:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 193us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572457.874488:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 70 00000001:00080000:0.0:1787572457.874716:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787572457.874878:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787572457.874937:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787572457.875051:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874405268470528:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787572457.875310:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572457.875350:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787572457.875361:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268470528 00000100:00100000:1.0:1787572457.875366:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268470528 00000100:00100000:1.0:1787572457.875408:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787572457.875417:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874405268470528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787572457.875495:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874405268470528:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572457.875503:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787572457.875527:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787572457.875533:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d1fbd14380, transno 4294967315 00000100:00100000:0.0:1787572457.875546:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874405268470528:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787572457.876315:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787572457.876381:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874405268470656:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787572457.876416:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572457.876443:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572457.876511:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268470656 00000100:00100000:1.0:1787572457.876522:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268470656 00000100:00100000:1.0:1787572457.876561:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787572457.876571:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874405268470656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787572457.876806:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1874405268470656:12345-0@lo:1000:mdt00_000.0 Request processed in 236us (388us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787572457.876815:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787572457.877063:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874405268470656:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787572457.877097:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877106:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877114:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877120:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572457.877124:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877131:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877148:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1e1353800) 00010000:00010000:0.0:1787572457.877151:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787572457.877163:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877170:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877495:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877503:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877509:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877515:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572457.877518:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877524:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877535:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:0.0:1787572457.877538:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787572457.877541:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877548:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f436eac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877577:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877592:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877609:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877662:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.877679:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 21 pid: 5844 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572457.877705:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbd35880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268470784:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572457.877771:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572457.879972:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbd35880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268470784:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572457.880004:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572457.881245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572457.881526:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244356224 00000100:00100000:0.0:1787572457.881534:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244356224 00010000:00010000:0.0:1787572457.881572:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 22 pid: 5844 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572457.881615:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:0.0:1787572457.881626:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:2354:x1874405244356224:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572457.881664:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572457.881672:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 22 pid: 5844 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.881711:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 22 pid: 5844 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.881735:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbbfe expref: 22 pid: 5844 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.881751:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:0.0:1787572457.881757:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.881767:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.881775:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572457.881906:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572457.881961:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:2354:x1874405244356224:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 336us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572457.881970:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 71 00010000:00010000:1.0:1787572457.882019:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882035:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882048:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882067:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882075:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882080:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572457.882085:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882091:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882102:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:1.0:1787572457.882105:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572457.882108:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882113:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f436f77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882125:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882130:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882143:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882149:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572457.882152:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882159:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882168:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1e1353300) 00010000:00010000:1.0:1787572457.882170:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787572457.882173:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.882179:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572457.882478:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:11525:x1874405244355968:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 12427us (12716us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787572457.882487:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 186 00000020:00080000:1.0:1787572457.882491:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787572457.882748:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787572457.882753:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787572457.883481:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787572457.883492:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787572457.889932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572457.891475:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244356480 00000100:00100000:3.0:1787572457.891489:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244356480 00000100:00100000:3.0:1787572457.891556:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:3.0:1787572457.891567:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7483c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:11525:x1874405244356480:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787572457.892338:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787572457.892450:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787572457.892508:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.892526:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.892537:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.892545:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.892551:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.892556:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572457.892579:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787572457.892716:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7483c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:11525:x1874405244356480:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1147us (2791us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787572457.892727:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00000020:00080000:3.0:1787572457.892733:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787572457.892899:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572457.892907:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.892915:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572457.892927:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.892936:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.892950:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d1c577ca00) 00010000:00010000:1.0:1787572457.892953:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787572457.892957:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.892963:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f436f7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572457.892978:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572457.892981:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572457.892983:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787572458.114753:0:12528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787572458.114765:0:12528:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572458.114802:0:12528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787572458.114809:0:12528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787572458.205869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572458.209283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244356736 00000100:00100000:1.0:1787572458.209301:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244356736 00000100:00100000:1.0:1787572458.209623:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 187 00000100:00100000:1.0:1787572458.209651:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:11535:x1874405244356736:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572458.209677:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572458.209712:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc36 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.209976:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.209991:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.210003:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572458.210021:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787572458.210199:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436f85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc36 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.210215:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc36 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.210224:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:1.0:1787572458.210226:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787572458.210230:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463400, rc 0) 00000100:00100000:1.0:1787572458.210311:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11535:x1874405244356736:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 678us (4452us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787572458.210319:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 187 00000100:00100000:2.0:1787572458.216835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.216913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244356864 00000100:00100000:3.0:1787572458.216926:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244356864 00000100:00100000:3.0:1787572458.216990:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00100000:3.0:1787572458.217000:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11535:x1874405244356864:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:3.0:1787572458.217092:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.217112:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.217176:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.217269:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.217278:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.217285:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218510:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218524:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218533:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787572458.218592:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218607:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218625:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218631:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218661:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572458.218665:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218672:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218695:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:3.0:1787572458.218698:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572458.218702:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218708:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f436f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218720:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218726:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218732:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218737:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572458.218746:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218752:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218760:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c577c600) 00010000:00010000:3.0:1787572458.218763:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572458.218765:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218771:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f436fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218785:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218792:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218797:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218802:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572458.218805:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218810:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218816:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572458.218818:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572458.218828:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.218834:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f436fa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572458.218930:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11535:x1874405244356864:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 1928us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572458.218939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 188 00010000:00010000:1.0:1787572458.288073:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572458.289379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572458.289452:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244357120 00000100:00100000:2.0:1787572458.289463:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244357120 00000100:00100000:2.0:1787572458.289529:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 189 00000100:00100000:2.0:1787572458.289542:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11538:x1874405244357120:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572458.289568:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572458.289590:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436faf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc3d expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.289722:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.289741:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.289754:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.289770:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.289777:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.289805:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290274:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290283:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290291:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572458.290301:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787572458.290417:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290425:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290433:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290440:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572458.290445:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290453:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290466:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572458.290469:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572458.290480:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290488:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f436fb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290500:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290506:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290513:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290519:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572458.290522:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290527:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290534:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c3a46000) 00010000:00010000:2.0:1787572458.290537:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572458.290539:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290545:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f436fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290583:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f436faf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 27 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290607:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 26 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.290615:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572458.290618:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572458.290620:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276a00, rc 0) 00000100:00100000:2.0:1787572458.291728:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11538:x1874405244357120:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 2183us (2350us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787572458.291739:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 189 00000100:00100000:2.0:1787572458.313511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572458.313698:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244357248 00000100:00100000:1.0:1787572458.313711:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244357248 00000100:00100000:0.0:1787572458.313842:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 190 00000100:00100000:0.0:1787572458.313920:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11538:x1874405244357248:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:0.0:1787572458.313985:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314018:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314029:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314056:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314063:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314070:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314076:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572458.314080:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314087:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314098:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:0.0:1787572458.314101:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572458.314106:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.314112:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f436fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572458.314202:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11538:x1874405244357248:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 287us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572458.316381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 190 00000100:00100000:0.0:1787572458.321016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.321136:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244357504 00000100:00100000:3.0:1787572458.321152:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244357504 00000100:00100000:3.0:1787572458.321229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:3.0:1787572458.321242:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11538:x1874405244357504:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1787572458.321906:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:11538:x1874405244357504:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 663us (905us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787572458.321917:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:2.0:1787572458.355104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572458.355428:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244357760 00000100:00100000:1.0:1787572458.355439:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244357760 00000100:00100000:1.0:1787572458.355616:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 191 00000100:00100000:1.0:1787572458.355628:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:11071:x1874405244357760:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1787572458.355712:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572458.355739:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436fd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc44 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.355878:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.355914:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 28 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.355924:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.355960:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 28 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.355974:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 28 pid: 7555 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572458.355989:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbce5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268470912:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572458.356096:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4193f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787572458.358947:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbce5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268470912:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572458.358992:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572458.359911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.360296:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244357888 00000100:00100000:3.0:1787572458.360311:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244357888 00010000:00010000:3.0:1787572458.360574:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 29 pid: 7555 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572458.360630:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:3.0:1787572458.360693:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:2353:x1874405244357888:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572458.360718:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572458.360728:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 29 pid: 7555 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.360745:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 29 pid: 7555 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.360795:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f436fc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc3d expref: 29 pid: 7555 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.360818:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:3.0:1787572458.360824:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.360837:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.360856:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.360894:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572458.360979:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:2353:x1874405244357888:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 301us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572458.360988:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 72 00010000:00010000:1.0:1787572458.361370:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.361395:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572458.361421:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787572458.361663:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462000/0x9fe530ef4f436fd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.361717:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.361726:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:1.0:1787572458.361729:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787572458.361732:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462a00, rc 0) 00000100:00100000:1.0:1787572458.361792:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:11071:x1874405244357760:12345-192.168.204.55@tcp:101:bash.0 Request processed in 6165us (6698us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787572458.361801:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 191 00000100:00100000:2.0:1787572458.365886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.365986:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244358144 00000100:00100000:3.0:1787572458.366002:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244358144 00000100:00100000:3.0:1787572458.366083:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 192 00000100:00100000:2.0:1787572458.366222:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:11071:x1874405244358144:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:2.0:1787572458.366817:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.366842:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.366856:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572458.366922:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787572458.366954:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ff59448 reply state 00000000612a604a transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572458.366986:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787572458.367044:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787572458.367200:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11071:x1874405244358144:12345-192.168.204.55@tcp:36:bash.0 Request processed in 1104us (1328us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787572458.367210:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 192 00000020:00080000:2.0:1787572458.367217:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787572458.369126:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.369145:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.369153:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.369159:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572458.369164:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.369172:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.369192:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:0.0:1787572458.369195:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572458.369199:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.369204:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f436fee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572458.371613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.377740:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244358272 00000100:00100000:3.0:1787572458.377766:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244358272 00000100:00100000:0.0:1787572458.378076:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 193 00000100:00100000:0.0:1787572458.378092:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11071:x1874405244358272:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572458.378128:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572458.378158:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc4b expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.378271:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc4b expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.378291:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc4b expref: 32 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.378317:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:0.0:1787572458.378321:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787572458.378326:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670400, rc 0) 00000100:00100000:0.0:1787572458.378736:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11071:x1874405244358272:12345-192.168.204.55@tcp:101:bash.0 Request processed in 647us (7137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572458.378746:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 193 00000100:00100000:2.0:1787572458.383674:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572458.383856:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244358400 00000100:00100000:1.0:1787572458.383870:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244358400 00000100:00100000:1.0:1787572458.383972:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:1.0:1787572458.383986:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:11071:x1874405244358400:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1787572458.384014:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572458.384043:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc52 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787572458.384084:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c30e6, atime: 0x6a8c30e4, ctime: 0x6a8c30e6, blocks: 0xb 00010000:00010000:1.0:1787572458.384114:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:1.0:1787572458.384120:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572458.384142:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.384165:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.384208:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462000, rc 0) 00000100:00100000:1.0:1787572458.384292:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:11071:x1874405244358400:12345-192.168.204.55@tcp:101:bash.0 Request processed in 310us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572458.384300:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00080000:2.0:1787572458.384480:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787572458.392705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572458.393567:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244358528 00000100:00100000:0.0:1787572458.393583:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244358528 00002000:00010000:0.0:1787572458.393696:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787572458.393703:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f4110000 with x1874405244358528 ext(0->18446744073709551615) 00002000:00010000:0.0:1787572458.393718:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f4110000. 00000100:00100000:0.0:1787572458.393766:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:0.0:1787572458.393779:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244358528:12345-192.168.204.55@tcp:10:bash.0 00002000:00010000:1.0:1787572458.394840:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787572458.394848:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787572454 -> 1787572456 00002000:00010000:1.0:1787572458.394851:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787572452 -> 1787572452 00002000:00010000:1.0:1787572458.394853:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787572454 -> 1787572456 00002000:00010000:1.0:1787572458.394854:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787572458.394952:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2354:x1874405244358528:12345-192.168.204.55@tcp:10:bash.0 Request processed in 1173us (2272us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787572458.394962:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00002000:00010000:1.0:1787572458.394968:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787572458.394971:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f4110000 with x1874405244358528 ext(0->18446744073709551615) 00002000:00010000:1.0:1787572458.394987:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f4110000. 00000100:00100000:1.0:1787572458.475351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572458.475710:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244358656 00000100:00100000:0.0:1787572458.475729:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244358656 00000100:00100000:0.0:1787572458.475885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 194 00000100:00100000:0.0:1787572458.475900:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11552:x1874405244358656:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:0.0:1787572458.476037:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476111:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476140:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476148:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476155:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476545:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476555:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476562:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787572458.476617:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476630:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476697:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476716:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476722:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572458.476727:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476736:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476756:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:0.0:1787572458.476760:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572458.476766:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476773:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f437003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476790:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476796:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476802:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476808:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572458.476811:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476829:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476839:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1e1353800) 00010000:00010000:0.0:1787572458.476841:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572458.476845:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476851:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f43700a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476866:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476872:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476878:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476883:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572458.476886:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476892:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476899:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:0.0:1787572458.476901:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572458.476904:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.476922:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f437011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572458.477154:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11552:x1874405244358656:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 1252us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572458.477167:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 194 00000100:00100000:2.0:1787572458.510373:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572458.510626:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244358912 00000100:00100000:1.0:1787572458.510688:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244358912 00000100:00100000:1.0:1787572458.510771:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 195 00000100:00100000:1.0:1787572458.510785:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+32:11555:x1874405244358912:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572458.510813:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572458.510845:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f437018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc59 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.510971:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.510989:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.511004:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.511020:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.511027:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.511034:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515467:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43702d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515497:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43702d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515512:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43702d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572458.515530:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787572458.515715:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515725:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515743:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515751:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572458.515756:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515764:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515781:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:1.0:1787572458.515785:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572458.515790:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515795:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f43701f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515813:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515819:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515824:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515829:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572458.515892:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515909:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515919:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572458.515921:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572458.515925:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.515931:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f437026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.516080:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f437018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc59 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.516101:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43702d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc59 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.516109:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:1.0:1787572458.516112:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787572458.516115:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030200, rc 0) 00000100:00100000:1.0:1787572458.516237:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11555:x1874405244358912:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 5454us (5880us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787572458.516249:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 195 00000100:00100000:2.0:1787572458.527604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572458.527782:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244359040 00000100:00100000:0.0:1787572458.527798:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244359040 00000100:00100000:0.0:1787572458.527922:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 196 00000100:00100000:0.0:1787572458.527936:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11555:x1874405244359040:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:0.0:1787572458.528036:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.528059:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.528070:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.528139:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.528156:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 34 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572458.528175:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268471040:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572458.528435:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787572458.532002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572458.532117:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244359296 00000100:00100000:1.0:1787572458.532142:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244359296 00000100:00100000:1.0:1787572458.532233:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:1.0:1787572458.532248:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:5593:x1874405244359296:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787572458.532915:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268471040:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572458.532951:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572458.534006:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:5593:x1874405244359296:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 1748us (2006us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787572458.534024:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:3.0:1787572458.538833:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572458.538973:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244359424 00000100:00100000:2.0:1787572458.538986:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244359424 00010000:00010000:2.0:1787572458.539046:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 36 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572458.539264:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00100000:2.0:1787572458.539279:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:2354:x1874405244359424:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572458.539302:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572458.539312:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 36 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.539328:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 36 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.539505:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462a00/0x9fe530ef4f436fe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc44 expref: 36 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.539541:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572458.539548:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.539559:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.539569:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.539625:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572458.539780:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:2354:x1874405244359424:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 503us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572458.539789:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 73 00010000:00010000:1.0:1787572458.540076:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.540102:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.540153:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.540160:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.540167:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.540173:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572458.540177:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.540184:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.540195:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:1.0:1787572458.540198:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572458.540202:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572458.540209:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671a00/0x9fe530ef4f43703b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572458.540275:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11555:x1874405244359040:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 12343us (12685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572458.540286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 196 00000100:00100000:1.0:1787572458.543631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.543889:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244359680 00000100:00100000:3.0:1787572458.543905:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244359680 00000100:00100000:3.0:1787572458.543972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:3.0:1787572458.543984:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+34:11555:x1874405244359680:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1787572458.544344:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11555:x1874405244359680:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 361us (730us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787572458.544353:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:1.0:1787572458.610477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.612615:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244359936 00000100:00100000:3.0:1787572458.612715:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244359936 00000100:00100000:3.0:1787572458.612832:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 197 00000100:00100000:3.0:1787572458.612847:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+35:11566:x1874405244359936:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:3.0:1787572458.612885:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572458.612917:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc60 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613029:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613050:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613065:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613081:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613089:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613096:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613577:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613595:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613603:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572458.613615:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787572458.613821:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613830:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613837:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613843:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572458.613848:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613857:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613871:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:3.0:1787572458.613875:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572458.613881:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613888:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613902:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613915:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613921:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613927:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572458.613930:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613937:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613946:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c577c000) 00010000:00010000:3.0:1787572458.613949:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572458.613952:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.613958:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.614018:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc60 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.614032:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc60 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.614039:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:3.0:1787572458.614041:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572458.614052:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eac00, rc 0) 00000100:00100000:3.0:1787572458.614138:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+37:11566:x1874405244359936:12345-192.168.204.55@tcp:101:cat.0 Request processed in 1294us (3681us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787572458.614148:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 197 00000100:00100000:3.0:1787572458.627288:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572458.627509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244360192 00000100:00100000:0.0:1787572458.627525:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244360192 00000100:00100000:0.0:1787572458.627603:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:0.0:1787572458.627616:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+37:11566:x1874405244360192:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:0.0:1787572458.628208:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:11566:x1874405244360192:12345-192.168.204.55@tcp:35:cat.0 Request processed in 592us (936us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787572458.628218:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:1.0:1787572458.666112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572458.667464:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244360448 00000100:00100000:2.0:1787572458.667482:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244360448 00000100:00100000:2.0:1787572458.667568:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 198 00000100:00100000:2.0:1787572458.667581:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:11567:x1874405244360448:12345-192.168.204.55@tcp:36:rm.0 00010000:00010000:2.0:1787572458.667709:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787572458.667748:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc60 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.667778:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43702d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc59 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.667822:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f436ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc4b expref: 36 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.667834:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46500) 00010000:00010000:2.0:1787572458.667846:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787572458.667878:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.667894:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.667905:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.667922:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.667929:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.667936:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.668380:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.668390:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.668397:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787572458.669229:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787572458.669243:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388765607151ns, next at 389765603817ns, rc = 0 00010000:00010000:2.0:1787572458.669325:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669336:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669347:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669354:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669361:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669368:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669400:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787572458.669435:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572458.669442:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669449:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572458.669454:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669465:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669491:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46e00) 00010000:00010000:2.0:1787572458.669494:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787572458.669500:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669506:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f43707a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669521:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572458.669523:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572458.669525:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572458.669545:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669552:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669558:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669564:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572458.669568:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669575:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669583:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d1c3a46e00) 00010000:00010000:2.0:1787572458.669585:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787572458.669588:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669605:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437073 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669629:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669686:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669692:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669697:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572458.669700:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669705:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669715:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572458.669717:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572458.669720:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.669726:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437065 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787572458.669736:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea7bf7fa reply state 00000000b75d0af5 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572458.669748:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572458.669880:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+37:11567:x1874405244360448:12345-192.168.204.55@tcp:36:rm.0 Request processed in 2297us (3781us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787572458.669891:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 198 00010000:00010000:2.0:1787572458.680454:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.681429:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.681448:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.681455:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572458.681461:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.681469:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.681496:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c3a46000) 00010000:00010000:2.0:1787572458.681499:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572458.681506:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.681513:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43706c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572458.742242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.742850:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244360704 00000100:00100000:3.0:1787572458.742867:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244360704 00000100:00100000:3.0:1787572458.742966:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 199 00000100:00100000:3.0:1787572458.743295:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+36:11573:x1874405244360704:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1787572458.743344:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572458.743529:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437081 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc67 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.743817:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.743838:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.743852:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.743869:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.743877:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.743885:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787572458.751054:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787572458.755213:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755257:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755275:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755387:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755395:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755410:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755416:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572458.755422:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755430:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755447:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:3.0:1787572458.755450:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572458.755454:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755482:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437088 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787572458.755502:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002002a2c reply state 00000000df0b95a5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572458.755512:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787572458.755570:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437081 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755588:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.755596:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c600) 00010000:00010000:3.0:1787572458.755598:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572458.755601:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eac00, rc 0) 00000100:00100000:3.0:1787572458.759125:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:11573:x1874405244360704:12345-192.168.204.55@tcp:101:bash.0 Request processed in 16128us (16878us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787572458.759143:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 199 00010000:00010000:0.0:1787572458.768354:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.768380:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.768390:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.768397:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572458.768402:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.768409:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.768432:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c577c000) 00010000:00010000:0.0:1787572458.768435:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572458.768439:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.768445:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43708f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572458.772098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572458.772690:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244360832 00000100:00100000:0.0:1787572458.772706:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244360832 00000100:00080000:2.0:1787572458.772786:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572458.772913:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:0.0:1787572458.772929:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244360832:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1787572458.772964:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572458.773007:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc6e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787572458.773047:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572458.773079:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1787572458.773085:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572458.773099:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.773123:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.773142:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670600, rc 0) 00000100:00100000:0.0:1787572458.773232:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244360832:12345-192.168.204.55@tcp:101:bash.0 Request processed in 307us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572458.773240:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:1.0:1787572458.779434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572458.779604:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244360960 00000100:00100000:3.0:1787572458.779617:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244360960 00000100:00100000:3.0:1787572458.779756:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:3.0:1787572458.779769:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:11573:x1874405244360960:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1787572458.779798:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572458.779823:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc75 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.779900:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572458.779911:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572458.779916:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572458.779922:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.781031:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.781064:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 9 pid: 6692 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572458.781099:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4111180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1874405268471168:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572458.781257:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e12caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787572458.786631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572458.787058:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4111180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1874405268471168:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572458.787115:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572458.787142:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea200, rc 0) 00000100:00100000:2.0:1787572458.787223:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:11573:x1874405244360960:12345-192.168.204.55@tcp:101:bash.0 Request processed in 7456us (7806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572458.787234:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:3.0:1787572458.791975:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244361088 00000100:00100000:3.0:1787572458.792003:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244361088 00010000:00010000:0.0:1787572458.792216:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 9 pid: 6692 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572458.792320:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:0.0:1787572458.792352:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2354:x1874405244361088:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572458.792374:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572458.792412:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 9 pid: 6692 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.792430:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 9 pid: 6692 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.792461:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d6d669/0x9fe530ef4f4370a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc6e expref: 9 pid: 6692 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.792483:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572458.792489:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572458.792499:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.792525:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572458.792585:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572458.792604:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1874405268471296:192.168.204.55@tcp:105: 00000100:00100000:0.0:1787572458.792790:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787572458.797712:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1874405268471296:192.168.204.55@tcp:105: 00010000:00010000:0.0:1787572458.797785:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572458.797872:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244361088:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 5521us (11255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572458.797886:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:1.0:1787572458.799489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572458.799574:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244361344 00000100:00100000:0.0:1787572458.799588:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244361344 00000100:00100000:0.0:1787572458.799792:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:0.0:1787572458.799806:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+38:11573:x1874405244361344:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:0.0:1787572458.800317:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:11573:x1874405244361344:12345-192.168.204.55@tcp:35:bash.0 Request processed in 512us (837us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787572458.800326:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:1.0:1787572459.026248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572459.027026:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244361472 00000100:00100000:2.0:1787572459.027043:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244361472 00000100:00100000:2.0:1787572459.027157:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 200 00000100:00100000:2.0:1787572459.027174:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+39:11589:x1874405244361472:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572459.027500:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572459.027533:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f4370b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.027770:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4370b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.027786:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4370b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.027801:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4370b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787572459.027964:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787572459.028108:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787572459.028112:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572459.028142:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4370b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.028177:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f4370b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc7c expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.028434:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4370b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc7c expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.028446:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572459.028450:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787572459.028453:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276800, rc 0) 00000100:00100000:2.0:1787572459.028623:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+40:11589:x1874405244361472:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1440us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572459.028692:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 200 00000100:00100000:1.0:1787572459.037872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572459.038090:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244361728 00000100:00100000:0.0:1787572459.038104:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244361728 00000100:00100000:0.0:1787572459.038266:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 201 00000100:00100000:0.0:1787572459.038280:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+40:11589:x1874405244361728:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572459.038311:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572459.038340:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4370c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc83 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.038501:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4370c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.038517:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4370c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.038531:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4370c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572459.038571:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787572459.044326:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4370c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc83 expref: 43 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.044367:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4370c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc83 expref: 42 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.044381:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c600) 00010000:00010000:0.0:1787572459.044384:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572459.044391:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670800, rc 0) 00000100:00100000:0.0:1787572459.045301:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+42:11589:x1874405244361728:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 7013us (7706us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787572459.045315:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 201 00000100:00100000:1.0:1787572459.056058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572459.056152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572459.056510:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244361984 00000100:00100000:2.0:1787572459.056523:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244361984 00000100:00100000:2.0:1787572459.056624:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 202 00000100:00100000:2.0:1787572459.056672:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+42:11589:x1874405244361984:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572459.056713:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572459.056745:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f4370d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc8a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.056907:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4370dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.056954:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4370dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.056970:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4370dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572459.056988:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:3.0:1787572459.057498:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244362112 00000100:00100000:3.0:1787572459.057507:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244362112 00000100:00100000:3.0:1787572459.057571:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:3.0:1787572459.057582:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+45:2356:x1874405244362112:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572459.057609:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572459.057687:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4370c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc83 expref: 45 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.057715:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c600) 00010000:00010000:3.0:1787572459.057722:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572459.057819:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+44:2356:x1874405244362112:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 238us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572459.057827:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00010000:00010000:2.0:1787572459.058495:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f4370d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc8a expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.058522:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4370dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc8a expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.058531:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c600) 00010000:00010000:2.0:1787572459.058533:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787572459.058536:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277600, rc 0) 00000100:00100000:2.0:1787572459.058584:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+43:11589:x1874405244361984:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1950us (2545us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787572459.059254:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 202 00000100:00100000:3.0:1787572459.065290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572459.065398:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244362240 00000100:00100000:2.0:1787572459.065412:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244362240 00000100:00100000:2.0:1787572459.065507:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:2.0:1787572459.065521:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2353:x1874405244362240:12345-192.168.204.55@tcp:1:lfs.0 00010000:00010000:2.0:1787572459.065590:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.065631:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.065711:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787572459.065716:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572459.065723:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.065773:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.065790:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 8 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572459.065810:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4111180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1874405268471424:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572459.065937:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1de013b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787572459.069207:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4111180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1874405268471424:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572459.069254:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.070722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572459.070848:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244362368 00000100:00100000:0.0:1787572459.070860:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244362368 00002000:00100000:0.0:1787572459.070936:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98d1f4159c00 x1874405244362368/t0(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:495/0 lens 504/0 e 0 to 0 dl 1787572470 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787572459.070950:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f4159c00 with x1874405244362368 ext(0->8) 00010000:00010000:0.0:1787572459.070962:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 9 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.070983:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 9 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787572459.070992:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d1f4159c00 00000100:00100000:0.0:1787572459.071037:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:0.0:1787572459.071055:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2354:x1874405244362368:12345-192.168.204.55@tcp:4:lfs.0 00000100:00100000:0.0:1787572459.071843:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:2354:x1874405244362368:12345-192.168.204.55@tcp:4:lfs.0 Request processed in 783us (1127us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787572459.071854:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00002000:00100000:0.0:1787572459.071864:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98d1f4159c00 x1874405244362368/t4294967308(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:495/0 lens 504/448 e 0 to 0 dl 1787572470 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787572459.071873:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f4159c00 with x1874405244362368 ext(0->8) 00010000:00010000:0.0:1787572459.071883:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 11 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.071898:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 11 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787572459.071906:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d1f4159c00 00000100:00100000:1.0:1787572459.076085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.076196:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244362496 00000100:00100000:3.0:1787572459.076210:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244362496 00010000:00010000:3.0:1787572459.076267:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 11 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.076314:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:3.0:1787572459.076326:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:2356:x1874405244362496:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572459.076347:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787572459.076377:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787572459.076380:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787572457 00002000:00010000:3.0:1787572459.076383:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787572457 00002000:00010000:3.0:1787572459.076385:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787572457 00010000:00010000:3.0:1787572459.076392:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 11 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.076408:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 11 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.076443:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4370ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc75 expref: 11 pid: 6690 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.076464:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572459.076469:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572459.076475:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.076487:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.076587:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787572459.077914:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.078209:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.078256:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.078285:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.078294:0:12010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.078301:0:12010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572459.078307:0:12010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.078316:0:12010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.078336:0:12010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.078344:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e908232d/0x9fe530ef4f4370ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.078889:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:2356:x1874405244362496:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 2555us (2811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572459.078905:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:2.0:1787572459.079243:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2353:x1874405244362240:12345-192.168.204.55@tcp:1:lfs.0 Request processed in 13723us (13971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572459.079255:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:1.0:1787572459.083363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.083556:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244362752 00000100:00100000:3.0:1787572459.083570:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244362752 00000100:00100000:3.0:1787572459.083905:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:3.0:1787572459.083919:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7482450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+43:11589:x1874405244362752:12345-192.168.204.55@tcp:35:lfs.0 00000004:00010000:3.0:1787572459.084031:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4370dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc8a expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787572459.084400:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787572459.084454:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787572459.084931:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787572459.085010:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.085033:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.085044:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.085096:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.085117:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 47 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.085155:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4159f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1874405268471552:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572459.085800:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fbeb33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572459.089019:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4159f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1874405268471552:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572459.089069:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572459.091700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.093090:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244362880 00000100:00100000:3.0:1787572459.093111:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244362880 00010000:00010000:3.0:1787572459.093178:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 48 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.093244:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:3.0:1787572459.093258:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+48:2354:x1874405244362880:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572459.093281:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572459.093290:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 48 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.093307:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 48 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.093335:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f437096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc67 expref: 48 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.093359:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c600) 00010000:00010000:3.0:1787572459.093364:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.093399:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.093408:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.093454:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572459.093550:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+47:2354:x1874405244362880:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 294us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572459.093558:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00010000:00010000:1.0:1787572459.095630:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.095694:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572459.095887:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787572459.096194:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787572459.096368:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbca8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874405268471680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787572459.096500:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572459.096546:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4193d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787572459.097426:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268471680 00000100:00100000:3.0:1787572459.097441:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268471680 00000100:00100000:3.0:1787572459.097545:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787572459.097559:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1874405268471680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787572459.101489:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1874405268471680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 3912us (4968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572459.101511:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787572459.101959:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbca8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874405268471680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787572459.103291:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00080000:1.0:1787572459.103508:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572459.103923:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1eacd2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874405268471808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787572459.104026:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572459.104143:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787572459.107783:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268471808 00000100:00100000:1.0:1787572459.107805:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268471808 00000100:00100000:2.0:1787572459.108063:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572459.108083:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1874405268471808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787572459.109018:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5845:x1874405268471808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 936us (4985us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787572459.109033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787572459.109271:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1eacd2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1874405268471808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787572459.109475:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787572459.109546:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.109562:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.109571:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.109580:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572459.109586:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.109762:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.109786:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c600) 00010000:00010000:1.0:1787572459.109790:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787572459.109796:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.109803:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f4370f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787572459.110058:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787572459.110455:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787572459.110470:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389206833711ns, next at 390206830905ns, rc = 0 00000001:00080000:1.0:1787572459.110479:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787572459.110535:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c600) 00010000:00010000:1.0:1787572459.110539:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787572459.110549:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4370dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc8a expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572459.110909:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7482450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+50:11589:x1874405244362752:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 26991us (27564us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787572459.110920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 56 00000020:00080000:1.0:1787572459.110927:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787572459.114317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.114477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244363008 00000100:00100000:3.0:1787572459.114493:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244363008 00000100:00100000:3.0:1787572459.114622:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 203 00000100:00100000:3.0:1787572459.114748:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+50:11589:x1874405244363008:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572459.114786:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572459.114821:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4370f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc91 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.114918:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4370f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc91 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.114961:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4370f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc91 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.114989:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572459.114992:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572459.114996:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eac00, rc 0) 00000100:00100000:3.0:1787572459.115079:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+51:11589:x1874405244363008:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 445us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572459.115088:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 203 00000100:00100000:0.0:1787572459.120008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.120209:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244363264 00000100:00100000:3.0:1787572459.120224:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244363264 00000100:00100000:3.0:1787572459.120339:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:3.0:1787572459.120355:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+51:11589:x1874405244363264:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1787572459.120772:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+52:11589:x1874405244363264:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 421us (851us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787572459.120781:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:1.0:1787572459.216441:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572459.216560:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244363392 00000100:00100000:2.0:1787572459.216574:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244363392 00000100:00100000:2.0:1787572459.216809:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 204 00000100:00100000:2.0:1787572459.216822:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+52:11599:x1874405244363392:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:2.0:1787572459.216945:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.216968:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.216982:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217001:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217009:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217015:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217162:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217172:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217201:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787572459.217259:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217274:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217281:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217290:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217296:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572459.217301:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217309:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217321:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572459.217324:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572459.217329:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217335:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f4370ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217351:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217362:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217369:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217374:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572459.217378:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217384:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217392:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c3a46000) 00010000:00010000:2.0:1787572459.217394:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572459.217397:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217403:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217419:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217424:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217430:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217435:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572459.217443:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217449:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217456:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:2.0:1787572459.217458:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572459.217461:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.217466:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f43710d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572459.217566:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+52:11599:x1874405244363392:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 745us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572459.217575:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 204 00000100:00100000:0.0:1787572459.262742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572459.262969:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244363648 00000100:00100000:2.0:1787572459.262986:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244363648 00000100:00100000:2.0:1787572459.263074:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 205 00000100:00100000:2.0:1787572459.263088:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+52:11602:x1874405244363648:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572459.263122:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572459.263153:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc98 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263264:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263282:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263322:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263342:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263350:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263357:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263541:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263551:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263558:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572459.263570:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787572459.263769:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263778:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263785:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263792:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572459.263805:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263814:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263830:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:2.0:1787572459.263833:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572459.263839:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263845:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f43711b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263863:0:7555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263870:0:7555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263875:0:7555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263881:0:7555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572459.263884:0:7555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263891:0:7555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263899:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1c3a46000) 00010000:00010000:2.0:1787572459.263901:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572459.263911:0:7555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263918:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276600/0x9fe530ef4f437122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263976:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f437114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 55 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.263993:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 54 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.264001:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:2.0:1787572459.264004:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572459.264007:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276400, rc 0) 00000100:00100000:2.0:1787572459.264119:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:11602:x1874405244363648:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1034us (1404us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787572459.264129:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 205 00000100:00100000:0.0:1787572459.273909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572459.276046:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244363776 00000100:00100000:1.0:1787572459.276071:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244363776 00000100:00100000:1.0:1787572459.276191:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 206 00000100:00100000:1.0:1787572459.276205:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:11602:x1874405244363776:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1787572459.276322:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276345:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276361:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276414:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276447:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276455:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276462:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572459.276468:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276477:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276492:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572459.276495:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572459.276501:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.276507:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572459.276850:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:11602:x1874405244363776:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 646us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572459.276860:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 206 00000100:00100000:1.0:1787572459.281742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572459.281852:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244364032 00000100:00100000:0.0:1787572459.281868:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244364032 00000100:00100000:0.0:1787572459.281954:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:0.0:1787572459.281968:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+54:11602:x1874405244364032:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572459.282351:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:11602:x1874405244364032:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 386us (627us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787572459.282361:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00010000:00010000:1.0:1787572459.313153:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572459.384423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.384691:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244364288 00000100:00100000:3.0:1787572459.384708:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244364288 00000100:00100000:3.0:1787572459.384795:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 207 00000100:00100000:3.0:1787572459.384810:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:11612:x1874405244364288:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1787572459.384846:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572459.384850:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787572459.384888:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f4370b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc7c expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.385006:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:3.0:1787572459.385013:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572459.385033:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f43713e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbc9f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.385241:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.385258:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 55 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.385269:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.385318:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 55 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.385335:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 55 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.385363:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4159f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268471936:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572459.385617:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fbeb33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572459.396921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572459.397234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244364416 00000100:00100000:0.0:1787572459.397248:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244364416 00010000:00010000:0.0:1787572459.397311:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 56 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572459.397375:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:0.0:1787572459.397388:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+56:2354:x1874405244364416:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572459.397408:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572459.397418:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 56 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.397435:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 56 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.397467:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:0.0:1787572459.397475:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.397488:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.397497:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.397524:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787572459.397780:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437129 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc98 expref: 56 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.397805:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4159f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268471936:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572459.397845:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.397857:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.397865:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572459.397891:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787572459.398134:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f43713e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.398154:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.398163:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572459.398166:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787572459.398169:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea400, rc 0) 00000100:00100000:0.0:1787572459.398311:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+56:2354:x1874405244364416:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 925us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572459.398326:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:3.0:1787572459.398532:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:11612:x1874405244364288:12345-192.168.204.55@tcp:101:bash.0 Request processed in 13725us (14124us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787572459.398539:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 207 00000100:00100000:1.0:1787572459.406339:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572459.406801:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244364672 00000100:00100000:2.0:1787572459.406816:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244364672 00000100:00100000:2.0:1787572459.406939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 208 00000100:00100000:2.0:1787572459.406952:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+55:11612:x1874405244364672:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:2.0:1787572459.407550:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.407579:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.407594:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572459.407814:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787572459.407852:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002179a142 reply state 000000009933c791 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572459.407864:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572459.408017:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+58:11612:x1874405244364672:12345-192.168.204.55@tcp:36:bash.0 Request processed in 1064us (1691us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787572459.408026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 208 00000020:00080000:2.0:1787572459.408033:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787572459.412393:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.412448:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.412457:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.412464:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572459.412471:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.412480:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.412579:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572459.412583:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572459.412591:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.412598:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277400/0x9fe530ef4f437153 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572459.425867:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572459.426229:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244364800 00000100:00100000:2.0:1787572459.426244:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244364800 00000100:00100000:2.0:1787572459.426334:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 209 00000100:00100000:2.0:1787572459.426347:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+57:11612:x1874405244364800:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1787572459.426382:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572459.426412:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43715a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbca6 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.426534:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.426552:0:7555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.426564:0:7555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.426617:0:7555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.426811:0:7555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 58 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572459.426828:0:7555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4111c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7555:1874405268472064:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572459.426933:0:7555:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572459.434734:0:7555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4111c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7555:1874405268472064:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572459.434790:0:7555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572459.437336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.437521:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244364928 00000100:00100000:3.0:1787572459.437534:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244364928 00010000:00010000:3.0:1787572459.437587:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 59 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.437689:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:3.0:1787572459.437703:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+59:2354:x1874405244364928:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572459.437745:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572459.437755:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 59 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.437773:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 59 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.437802:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437145 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc9f expref: 59 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.437823:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572459.437828:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.437838:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.437846:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.437883:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572459.437956:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+58:2354:x1874405244364928:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 256us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572459.437964:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 78 00010000:00010000:0.0:1787572459.439719:0:7555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.439741:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572459.439815:0:7555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787572459.439822:0:7555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572459.439850:0:7555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.439900:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43715a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 58 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.439925:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 57 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.439943:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:0.0:1787572459.439946:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572459.439950:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277c00, rc 0) 00000100:00100000:0.0:1787572459.440067:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+57:11612:x1874405244364800:12345-192.168.204.55@tcp:101:bash.0 Request processed in 13720us (14213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572459.440104:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 209 00000100:00100000:1.0:1787572459.446150:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.446515:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244365184 00000100:00100000:3.0:1787572459.446529:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244365184 00000100:00100000:2.0:1787572459.446957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:2.0:1787572459.446973:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+57:11612:x1874405244365184:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:2.0:1787572459.447559:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+58:11612:x1874405244365184:12345-192.168.204.55@tcp:35:bash.0 Request processed in 588us (1423us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787572459.447569:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:2.0:1787572459.556938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572459.557250:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244365312 00000100:00100000:1.0:1787572459.557263:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244365312 00000100:00100000:1.0:1787572459.557350:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 210 00000100:00100000:1.0:1787572459.557364:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+58:11618:x1874405244365312:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572459.557400:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572459.557443:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.557530:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f43716f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.557548:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f43716f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.557562:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f43716f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572459.557697:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787572459.557701:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572459.557732:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f43716f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.557766:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcad expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.557792:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f43716f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcad expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.557802:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:1.0:1787572459.557806:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572459.557811:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0031000, rc 0) 00000100:00100000:1.0:1787572459.557893:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+59:11618:x1874405244365312:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 532us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572459.557901:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 210 00000100:00100000:0.0:1787572459.563271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572459.563340:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244365440 00000100:00100000:0.0:1787572459.563352:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244365440 00000100:00100000:0.0:1787572459.563436:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 211 00000100:00100000:0.0:1787572459.563449:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+59:11618:x1874405244365440:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572459.563479:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572459.563506:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcb4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563593:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563612:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563626:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563673:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563681:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563688:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563821:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563850:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.563859:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572459.563911:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787572459.563916:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572459.564145:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564161:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564171:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564178:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564185:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564192:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572459.564197:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564205:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564220:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:0.0:1787572459.564224:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572459.564237:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564244:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670c00/0x9fe530ef4f43717d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564261:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564268:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564274:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564279:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572459.564283:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564288:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564297:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1e1353000) 00010000:00010000:0.0:1787572459.564299:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572459.564303:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564309:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670200/0x9fe530ef4f437184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564350:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564393:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.564402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:0.0:1787572459.564405:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572459.564408:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671400, rc 0) 00000100:00100000:0.0:1787572459.564505:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+60:11618:x1874405244365440:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1058us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572459.564514:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 211 00000100:00100000:3.0:1787572459.577668:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.577717:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.577754:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244365824 00000100:00100000:3.0:1787572459.577785:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244365824 00000100:00100000:3.0:1787572459.577863:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 212 00000100:00100000:3.0:1787572459.577876:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+60:11618:x1874405244365824:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572459.577911:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572459.578064:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcbb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.578289:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.578309:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 61 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.578319:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.578329:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.578390:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.578409:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 61 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.578427:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4158e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268472192:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572459.578568:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 61 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.578595:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 61 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.578606:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4159500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268472320:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572459.578679:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1ead3cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787572459.580542:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244365568 00000100:00100000:1.0:1787572459.580581:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244365568 00010000:00010000:1.0:1787572459.580670:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 62 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572459.580713:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:1.0:1787572459.580726:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+62:2355:x1874405244365568:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572459.580746:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572459.580753:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 62 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.580769:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 62 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.580795:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572459.580802:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.580810:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.580818:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572459.580883:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+62:2355:x1874405244365568:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 160us (3263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572459.580891:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:0.0:1787572459.588574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572459.588622:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244365952 00000100:00100000:0.0:1787572459.588650:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244365952 00010000:00010000:0.0:1787572459.588720:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 62 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572459.588767:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:0.0:1787572459.588779:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+62:2354:x1874405244365952:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572459.588798:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572459.588806:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 62 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.588822:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 62 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.588850:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:0.0:1787572459.588873:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.588886:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.588894:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572459.589205:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572459.589284:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+62:2354:x1874405244365952:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 505us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572459.589293:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00010000:00010000:3.0:1787572459.591774:0:5842:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.55@tcp) returned -22 from blocking AST (req@00000000602208d7 x1874405268472192) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 61 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.591808:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671400/0x9fe530ef4f43718b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcb4 expref: 61 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.591831:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4158e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268472192:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572459.592072:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277c00/0x9fe530ef4f437161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbca6 expref: 60 pid: 7555 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.592086:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4159500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268472320:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572459.592265:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572459.592277:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.597046:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.597072:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572459.597482:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787572459.597779:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea400/0x9fe530ef4f437192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.597805:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.597816:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:2.0:1787572459.597836:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787572459.597841:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea800, rc 0) 00000100:00100000:2.0:1787572459.597946:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+60:11618:x1874405244365824:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 20071us (20226us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787572459.597958:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 212 00000100:00100000:0.0:1787572459.601702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572459.601798:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244366208 00000100:00100000:2.0:1787572459.601811:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244366208 00000100:00100000:2.0:1787572459.601891:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:2.0:1787572459.601901:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+60:11618:x1874405244366208:12345-192.168.204.55@tcp:103:lfs.0 00010000:00010000:2.0:1787572459.601931:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572459.601965:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4370f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc91 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572459.601991:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:2.0:1787572459.601996:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572459.602065:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+59:11618:x1874405244366208:12345-192.168.204.55@tcp:103:lfs.0 Request processed in 165us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572459.602073:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:0.0:1787572459.607939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572459.608093:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244366336 00000100:00100000:1.0:1787572459.608118:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244366336 00000100:00100000:1.0:1787572459.608193:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 213 00000100:00100000:1.0:1787572459.608207:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+59:11618:x1874405244366336:12345-192.168.204.55@tcp:58:lfs.0 00010000:00010000:1.0:1787572459.608373:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.608396:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572459.608411:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787572459.608714:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787572459.608828:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+59:11618:x1874405244366336:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 622us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572459.608838:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 213 00000100:00100000:3.0:1787572459.612428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.612476:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244366464 00000100:00100000:3.0:1787572459.612488:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244366464 00000100:00100000:3.0:1787572459.612564:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 214 00000100:00100000:3.0:1787572459.612577:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+59:11618:x1874405244366464:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572459.612631:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572459.612693:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.612780:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.612794:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc2 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.612819:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.612835:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc2 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.612853:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572459.612856:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572459.612861:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc2 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.612870:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb200, rc 0) 00000100:00100000:3.0:1787572459.612958:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+60:11618:x1874405244366464:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 383us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572459.612966:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 214 00000001:00080000:1.0:1787572459.640869:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1787572459.640903:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787572459.640911:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000040:00080000:3.0:1787572459.951934:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787572459.951949:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572459.952026:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787572459.952039:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787572459.952230:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4158e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268472448:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787572459.952951:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1ead3c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572459.964941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572459.965032:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244366592 00000100:00100000:0.0:1787572459.965046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244366592 00000100:00100000:0.0:1787572459.965136:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 215 00000100:00100000:0.0:1787572459.965151:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+61:11619:x1874405244366592:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787572459.965208:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787572459.965398:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+61:11619:x1874405244366592:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 249us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572459.965407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 215 00000100:00100000:1.0:1787572459.965542:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4158e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268472448:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787572459.981808:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572459.983175:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244366720 00000100:00100000:3.0:1787572459.983195:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244366720 00000100:00100000:3.0:1787572459.983310:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 216 00000100:00100000:3.0:1787572459.983324:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+60:11619:x1874405244366720:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787572459.983450:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.983477:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.983496:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.983521:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.983529:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.983536:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.983566:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.983575:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.983618:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572459.987760:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787572459.987776:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572459.987814:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987844:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987853:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987861:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987868:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572459.987873:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987881:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987901:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:3.0:1787572459.987904:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572459.987909:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987916:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f4371b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987972:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987978:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.987984:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988004:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572459.988008:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988015:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988023:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff98d1c577cc00) 00010000:00010000:3.0:1787572459.988026:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572459.988029:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988036:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f4371bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988057:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988063:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988068:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988082:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572459.988085:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988102:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988112:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572459.988114:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572459.988118:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572459.988123:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f4371c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572459.988298:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+60:11619:x1874405244366720:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 4968us (6661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572459.988312:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 216 00000100:00100000:3.0:1787572460.022826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.026676:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244366976 00000100:00100000:0.0:1787572460.026702:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244366976 00000100:00100000:0.0:1787572460.026816:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 217 00000100:00100000:0.0:1787572460.026831:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+60:11619:x1874405244366976:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572460.026885:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572460.026914:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4371ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcc9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028531:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028563:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028581:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572460.028597:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787572460.028787:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028796:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028804:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028811:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572460.028816:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028825:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028842:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:0.0:1787572460.028865:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787572460.028872:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028878:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028954:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4371ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc9 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.028967:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:0.0:1787572460.028969:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572460.028974:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4371ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc9 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.029007:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670400, rc 0) 00000100:00100000:0.0:1787572460.029133:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+61:11619:x1874405244366976:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 2305us (6321us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787572460.029144:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 217 00000100:00100000:3.0:1787572460.035287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572460.048306:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244367104 00000100:00100000:1.0:1787572460.048337:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244367104 00000100:00100000:1.0:1787572460.048469:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 218 00000100:00100000:1.0:1787572460.048483:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+61:11619:x1874405244367104:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787572460.048540:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787572460.048730:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+61:11619:x1874405244367104:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 250us (13460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572460.048739:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 218 00000100:00100000:2.0:1787572460.068011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.068759:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244367360 00000100:00100000:0.0:1787572460.068777:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244367360 00000100:00100000:0.0:1787572460.068932:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 219 00000100:00100000:0.0:1787572460.068948:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+61:11619:x1874405244367360:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572460.068986:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572460.068990:0:7555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787572460.069040:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f43716f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcad expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.069075:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:0.0:1787572460.069116:0:7555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572460.069138:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4371df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcd0 expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787572460.069896:0:7555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787572460.070230:0:7555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.070248:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.070260:0:7555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.070337:0:7555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670400/0x9fe530ef4f4371df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd0 expref: 63 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.070360:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd0 expref: 62 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.070370:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1e1353600) 00010000:00010000:0.0:1787572460.070373:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787572460.070376:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670800, rc 0) 00000100:00100000:0.0:1787572460.070466:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+62:11619:x1874405244367360:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1522us (2474us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787572460.070476:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 219 00000100:00100000:2.0:1787572460.085480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572460.094144:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244367616 00000100:00100000:1.0:1787572460.094169:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244367616 00000100:00100000:1.0:1787572460.094277:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 220 00000100:00100000:1.0:1787572460.094314:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+62:11619:x1874405244367616:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787572460.094415:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572460.094456:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4371e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd0 expref: 62 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094482:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1e1353600) 00010000:00010000:1.0:1787572460.094498:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572460.094529:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094545:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094557:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094762:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094845:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094859:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094954:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094962:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094986:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.094992:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572460.094997:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095004:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095015:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:1.0:1787572460.095018:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572460.095021:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095027:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4371f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095041:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095047:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095052:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095057:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572460.095059:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095072:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095078:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x439c039d (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572460.095080:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572460.095083:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.095087:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f4371fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x439c039d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572460.095197:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+61:11619:x1874405244367616:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 883us (9732us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787572460.095208:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 220 00000100:00100000:1.0:1787572460.122841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.126700:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244367744 00000100:00100000:0.0:1787572460.126737:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244367744 00000100:00100000:1.0:1787572460.127166:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 221 00000100:00100000:1.0:1787572460.127182:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+61:11619:x1874405244367744:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572460.127213:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572460.127442:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f437202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcd7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.127493:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.127511:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.127526:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.128546:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f437202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.128594:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.128605:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:2.0:1787572460.128617:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787572460.128622:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030e00, rc 0) 00000100:00100000:2.0:1787572460.128977:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+62:11619:x1874405244367744:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1796us (6151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572460.128988:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 221 00000100:00100000:1.0:1787572460.137904:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.139492:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244368000 00000100:00100000:3.0:1787572460.139513:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244368000 00000100:00100000:3.0:1787572460.139621:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 222 00000100:00100000:3.0:1787572460.139676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+62:11619:x1874405244368000:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787572460.139942:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.139966:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.140003:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787572460.151443:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787572460.151472:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390247835489ns, next at 391247828782ns, rc = 0 00000004:00010000:2.0:1787572460.152342:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068a80b00 reply state 00000000354d947f transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572460.152921:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787572460.158257:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+64:11619:x1874405244368000:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 18594us (20339us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1787572460.158277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 222 00000100:00100000:2.0:1787572460.167185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.167352:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244368128 00000100:00100000:3.0:1787572460.167367:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244368128 00010000:00010000:0.0:1787572460.167464:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572460.167509:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 223 00000100:00100000:3.0:1787572460.167525:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+64:11619:x1874405244368128:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572460.167566:0:7555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572460.167596:0:7555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcde expref: -99 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.167844:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.167853:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.168244:0:7555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 65 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.168266:0:7555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 65 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.168478:0:7555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:2.0:1787572460.168483:0:7555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787572460.168488:0:7555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ebe00, rc 0) 00000100:00100000:2.0:1787572460.168832:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+65:11619:x1874405244368128:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1309us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572460.168905:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 223 00010000:00010000:0.0:1787572460.175528:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572460.176205:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.176225:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572460.177975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.178074:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244368256 00000100:00100000:3.0:1787572460.178099:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244368256 00000100:00080000:1.0:1787572460.178187:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787572460.178274:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:3.0:1787572460.178290:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2354:x1874405244368256:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787572460.178804:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:2354:x1874405244368256:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 515us (840us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787572460.178838:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00010000:00010000:0.0:1787572460.179003:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:0.0:1787572460.179009:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787572460.179021:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.179033:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb000/0x9fe530ef4f437210 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572460.192491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.192591:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244368512 00000100:00100000:0.0:1787572460.192605:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244368512 00000100:00100000:0.0:1787572460.192754:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:0.0:1787572460.192768:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+64:11619:x1874405244368512:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787572460.193453:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+65:11619:x1874405244368512:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 684us (976us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787572460.193464:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:1.0:1787572460.201051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572460.211196:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244368768 00000100:00100000:2.0:1787572460.211220:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244368768 00000100:00100000:2.0:1787572460.211353:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 224 00000100:00100000:2.0:1787572460.211373:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+65:11619:x1874405244368768:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787572460.211614:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+65:11619:x1874405244368768:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 249us (10580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572460.211628:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 224 00000100:00100000:1.0:1787572460.215115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572460.215847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244368896 00000100:00100000:2.0:1787572460.215863:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244368896 00000100:00100000:2.0:1787572460.215957:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 225 00000100:00100000:2.0:1787572460.215991:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+65:11619:x1874405244368896:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787572460.216021:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572460.216052:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43721e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbce5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.216153:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.216172:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.216186:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572460.216239:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787572460.216266:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.216300:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276a00/0x9fe530ef4f43721e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbce5 expref: 67 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.216325:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbce5 expref: 66 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.216335:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:2.0:1787572460.216339:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787572460.216343:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277e00, rc 0) 00000100:00100000:1.0:1787572460.223336:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+66:11619:x1874405244368896:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 7332us (8218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572460.223367:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 225 00000100:00100000:1.0:1787572460.229565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.229689:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244369024 00000100:00100000:3.0:1787572460.229718:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244369024 00000100:00100000:3.0:1787572460.229803:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:3.0:1787572460.229817:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+10:2355:x1874405244369024:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572460.229843:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572460.229877:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcec expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787572460.229926:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c30ea, blocks: 0x1 00010000:00010000:3.0:1787572460.229956:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1787572460.229962:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572460.229982:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.230010:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.230027:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ebc00, rc 0) 00000100:00100000:3.0:1787572460.230128:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:2355:x1874405244369024:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 314us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.230142:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:2.0:1787572460.233391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572460.233964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244369280 00000100:00100000:1.0:1787572460.233983:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244369280 00000100:00100000:1.0:1787572460.234071:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 226 00000100:00100000:1.0:1787572460.234084:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+66:11619:x1874405244369280:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787572460.234247:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+66:11619:x1874405244369280:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 165us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572460.234255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 226 00000100:00100000:1.0:1787572460.244065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572460.244295:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244369408 00000100:00100000:2.0:1787572460.244330:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244369408 00000100:00100000:2.0:1787572460.244426:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:2.0:1787572460.244440:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:11619:x1874405244369408:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787572460.244470:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572460.244496:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcf3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.244537:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 12 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.244549:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572460.244554:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572460.244560:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.244608:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 12 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.244625:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 12 pid: 6692 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572460.245293:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4112d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874405268472576:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572460.247747:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572460.254375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.254701:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4112d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1874405268472576:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572460.254755:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.254806:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276400, rc 0) 00000100:00100000:3.0:1787572460.254896:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+12:11619:x1874405244369408:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 10457us (10857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.254907:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:0.0:1787572460.264103:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244369536 00000100:00100000:0.0:1787572460.264153:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244369536 00010000:00010000:1.0:1787572460.264428:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 12 pid: 6692 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572460.264498:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:1.0:1787572460.264511:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+12:2353:x1874405244369536:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572460.264531:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572460.264801:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 12 pid: 6692 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.264819:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 12 pid: 6692 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.264866:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f43722c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcec expref: 12 pid: 6692 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.264888:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572460.264893:0:7642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572460.264905:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.264917:0:7642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.264973:0:7642:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572460.264992:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7642:1874405268472704:192.168.204.55@tcp:105: 00000100:00100000:1.0:1787572460.265118:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d5de2480 going to sleep for 11 seconds 00000100:00100000:1.0:1787572460.275275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.275604:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7642:1874405268472704:192.168.204.55@tcp:105: 00010000:00010000:3.0:1787572460.275693:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572460.275772:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:2353:x1874405244369536:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 11263us (21413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.275785:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:2.0:1787572460.275986:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244369664 00000100:00100000:2.0:1787572460.275996:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244369664 00002000:00100000:2.0:1787572460.276059:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98d0c5d55500 x1874405244369664/t0(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:496/0 lens 504/0 e 0 to 0 dl 1787572471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572460.276108:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d0c5d55500 with x1874405244369664 ext(0->12) 00002000:00010000:2.0:1787572460.276115:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d0c5d55500 00000100:00100000:2.0:1787572460.276140:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:2.0:1787572460.276151:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+11:2353:x1874405244369664:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787572460.278723:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2353:x1874405244369664:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 Request processed in 2555us (3446us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787572460.278740:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00002000:00100000:0.0:1787572460.278758:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98d0c5d55500 x1874405244369664/t4294967320(0) o4->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:496/0 lens 504/448 e 0 to 0 dl 1787572471 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787572460.278769:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d0c5d55500 with x1874405244369664 ext(0->12) 00002000:00010000:0.0:1787572460.278776:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d0c5d55500 00000100:00100000:2.0:1787572460.283079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.283828:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244369792 00000100:00100000:3.0:1787572460.283844:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244369792 00000100:00100000:3.0:1787572460.283923:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 227 00000100:00100000:3.0:1787572460.283935:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+66:11619:x1874405244369792:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1787572460.335660:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572460.386168:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+66:11619:x1874405244369792:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 102033us (102901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572460.386190:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 227 00000001:00080000:1.0:1787572460.386273:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1787572460.386300:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d1f3e4e540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787572460.386305:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1fc8a3400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d1f3e4eb40 00000020:00080000:1.0:1787572460.386310:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1fc8a3600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d1ef371400 00000020:00080000:1.0:1787572460.386347:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d1f3e4e000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787572460.386351:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1fc8a3800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d1f3e4e300 00000020:00080000:1.0:1787572460.386354:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1fc8a3500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d1f4140400 00000004:00080000:1.0:1787572460.386377:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1787572460.386428:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1787572460.386472:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787572460.387169:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787572460.387458:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787572460.388276:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268472832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787572460.388377:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572460.388782:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268472960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787572460.388819:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572460.398019:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572460.398050:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268473088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787572460.398140:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572460.398267:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268472832 00000100:00100000:3.0:1787572460.398279:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268472832 00000100:00100000:2.0:1787572460.398523:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268472960 00000100:00100000:2.0:1787572460.398529:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268472960 00000100:00100000:2.0:1787572460.398615:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787572460.398628:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268472960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787572460.398705:0:12010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787572460.398743:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.398773:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.398784:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787572460.398788:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787572460.398794:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.398876:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.398895:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 12 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572460.398910:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fbca8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268473216:192.168.204.55@tcp:104: 00000100:00080000:3.0:1787572460.399038:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572460.399804:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787572460.399818:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268472832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787572460.399853:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1787572460.399896:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c30e9, atime: 0x6a8c30e9, ctime: 0x6a8c30e9, blocks: 0xb 00010000:00010000:0.0:1787572460.399905:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.399920:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1787572460.399924:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572460.399932:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.399951:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.399962:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.400000:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.400024:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787572460.401885:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874405268472832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2062us (13499us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787572460.401901:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787572460.402034:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1787572460.402044:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:2.0:1787572460.402080:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d1d0b77100, transno 4294967307 00000004:00080000:2.0:1787572460.402093:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1787572460.402113:0:3311:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98d0c5d54a80 x1874405268472832/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787572476 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787572460.402127:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d0c5d54a80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787572460.402134:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268472832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787572460.402305:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4ed80 going to sleep for 11 seconds 00010000:00010000:1.0:1787572460.403506:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572460.403520:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.403536:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572460.403542:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.403553:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.403617:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.403625:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437241 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.403691:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572460.403694:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572460.403696:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572460.404944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.405435:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268473088 00000100:00100000:0.0:1787572460.405450:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268473088 00000100:00100000:0.0:1787572460.405508:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787572460.405522:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874405268473088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787572460.405781:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787572460.405786:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787572458 00002000:00010000:0.0:1787572460.405788:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787572460.405791:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787572458 -> 1787572458 00002000:00010000:0.0:1787572460.405793:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787572460.405905:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1874405268473088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 385us (7764us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787572460.405915:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:0.0:1787572460.406495:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d0c5d56680/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787572460.406504:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268473088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787572460.407130:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244369920 00000100:00100000:0.0:1787572460.407140:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244369920 00000100:00100000:0.0:1787572460.407228:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:0.0:1787572460.407239:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1eacd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2353:x1874405244369920:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787572460.415617:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fbca8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268473216:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572460.415710:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572460.418480:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.419039:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244370048 00000100:00100000:3.0:1787572460.419056:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244370048 00010000:00010000:3.0:1787572460.419139:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 14 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572460.419227:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:3.0:1787572460.419240:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+14:2353:x1874405244370048:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572460.419262:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572460.419270:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 14 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.419287:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 14 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.419319:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015ba2baa/0x9fe530ef4f436ffc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc52 expref: 14 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.419352:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572460.419357:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572460.419364:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.419377:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.419413:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787572460.428333:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.428363:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.428377:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.428385:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.429883:0:12010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787572460.430210:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572460.430222:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.430235:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572460.430241:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.430253:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.430280:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.430287:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f43723a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.430349:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572460.430351:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572460.430354:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572460.431947:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+13:2353:x1874405244370048:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 12689us (13460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.431966:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:0.0:1787572460.437032:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1874405268472960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38393us (48198us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787572460.437050:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1787572460.437228:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d0c5d57100/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787572460.437236:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268472960:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1787572460.566800:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1787572460.566827:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:3.0:1787572460.566840:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1787572460.567052:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1eacd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244369920:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 159805us (162112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572460.567068:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:0.0:1787572460.577479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572460.577682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244370304 00000100:00100000:1.0:1787572460.577698:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244370304 00000100:00100000:1.0:1787572460.577780:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 228 00000100:00100000:1.0:1787572460.577795:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:11619:x1874405244370304:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787572460.577890:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572460.577951:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbce5 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.577980:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572460.577986:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572460.578032:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.578052:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.578064:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572460.578859:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023536e9d reply state 00000000abc9eceb transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572460.579498:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787572460.579714:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:11619:x1874405244370304:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 1917us (2247us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787572460.579725:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 228 00000100:00100000:3.0:1787572460.588325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572460.592722:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244370432 00000100:00100000:2.0:1787572460.592746:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244370432 00000100:00100000:2.0:1787572460.592860:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:2.0:1787572460.592874:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244370432:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787572460.593216:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787572460.593221:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787572458 -> 1787572457 00002000:00010000:2.0:1787572460.593224:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787572457 00002000:00010000:2.0:1787572460.593246:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787572458 -> 1787572457 00002000:00010000:2.0:1787572460.593248:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787572460.593336:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244370432:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 464us (5028us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787572460.593601:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:3.0:1787572460.600018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572460.602091:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244370688 00000100:00100000:2.0:1787572460.602114:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244370688 00000100:00100000:2.0:1787572460.602219:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 229 00000100:00100000:2.0:1787572460.602233:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:11619:x1874405244370688:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787572460.602339:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.602361:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.602372:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.602423:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.605445:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 21 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572460.605485:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268473344:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572460.605680:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787572460.610967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.611143:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244370816 00000100:00100000:0.0:1787572460.611157:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244370816 00010000:00010000:0.0:1787572460.611215:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 22 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572460.611269:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:0.0:1787572460.611305:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:2354:x1874405244370816:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572460.611327:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572460.611335:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 22 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572460.611452:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f450c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874405268473344:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572460.614154:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.614179:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.614189:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.614196:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572460.614202:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.614213:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.614242:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572460.614246:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572460.614252:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.614259:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f437248 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.618058:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 21 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.618190:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f437209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcd7 expref: 21 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.618225:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:0.0:1787572460.618232:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.618244:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.618253:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.620210:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.625690:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572460.625821:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:2354:x1874405244370816:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 14508us (14859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.627355:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 83 00010000:00010000:3.0:1787572460.634346:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.634371:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.634419:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.634426:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.634445:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.634453:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572460.634459:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.634469:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.634524:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:3.0:1787572460.634528:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787572460.634534:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.634541:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f43724f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572460.634720:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11619:x1874405244370688:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 Request processed in 32482us (34709us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787572460.634734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 229 00000100:00100000:3.0:1787572460.637860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.638206:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244370944 00000100:00100000:0.0:1787572460.638223:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244370944 00000100:00100000:0.0:1787572460.638309:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:0.0:1787572460.638323:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244370944:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787572460.638390:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.638421:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.638472:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572460.638477:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787572460.638483:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.638540:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.638561:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 8 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572460.638587:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268473472:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572460.638765:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787572460.663160:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1874405268473472:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572460.663204:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572460.663823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.664309:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244371072 00000100:00100000:3.0:1787572460.664321:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244371072 00010000:00010000:3.0:1787572460.664380:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 9 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572460.664497:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:3.0:1787572460.664510:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+9:2354:x1874405244371072:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572460.664530:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572460.664572:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 9 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.664616:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 9 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.664678:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f437233 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcf3 expref: 9 pid: 6690 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.664702:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572460.664708:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572460.664716:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.664729:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.664767:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572460.664863:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2354:x1874405244371072:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 355us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.664872:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 84 00010000:00010000:0.0:1787572460.665061:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.665072:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.665118:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.665127:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.665145:0:12010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.665154:0:12010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572460.665159:0:12010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.665169:0:12010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.665184:0:12010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572460.665192:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f437256 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572460.665249:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2354:x1874405244370944:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 26930us (27423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572460.665257:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:2.0:1787572460.681789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.682274:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244371328 00000100:00100000:3.0:1787572460.682290:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244371328 00000100:00100000:3.0:1787572460.682378:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 230 00000100:00100000:3.0:1787572460.682392:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11619:x1874405244371328:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787572460.682705:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.682729:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.682762:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.683343:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.683360:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 20 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.683370:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.683426:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 20 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.684548:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 20 pid: 7555 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572460.684576:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4159180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268473600:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572460.689748:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787572460.695500:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4159180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268473600:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572460.695547:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572460.695772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.696218:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244371456 00000100:00100000:3.0:1787572460.696228:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244371456 00010000:00010000:3.0:1787572460.696281:0:7642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 21 pid: 7555 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572460.696363:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:3.0:1787572460.696376:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:2354:x1874405244371456:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572460.696396:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572460.696405:0:7642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 21 pid: 7555 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.696421:0:7642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 21 pid: 7555 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.696461:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437217 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcde expref: 21 pid: 7555 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.696485:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:3.0:1787572460.696490:0:7642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.696501:0:7642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.696510:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572460.696536:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572460.696603:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:2354:x1874405244371456:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 229us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.696612:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00010000:00010000:1.0:1787572460.697421:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.697460:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572460.697781:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787572460.697971:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787572460.698027:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787572460.698152:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874405268473728:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787572460.698233:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572460.698271:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4193f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572460.698484:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268473728 00000100:00100000:3.0:1787572460.698507:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268473728 00000100:00100000:3.0:1787572460.698566:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787572460.698579:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1874405268473728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787572460.698711:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1874405268473728:12345-0@lo:1000:mdt00_000.0 Request processed in 135us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.698720:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787572460.701582:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787572460.701602:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1787572460.703338:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d0c5d56680, transno 4294967321 00000100:00100000:1.0:1787572460.703389:0:5842:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98d0c5d57100 x1874405268472960/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787572476 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572460.703411:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874405268473728:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787572460.705594:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787572460.705746:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f42fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874405268473856:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787572460.705844:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572460.705888:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4193240 going to sleep for 11 seconds 00000100:00100000:3.0:1787572460.706869:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268473856 00000100:00100000:3.0:1787572460.706885:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268473856 00000100:00100000:3.0:1787572460.706965:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787572460.706978:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f42ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1874405268473856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787572460.707377:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f42ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1874405268473856:12345-0@lo:1000:mdt00_000.0 Request processed in 399us (1530us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787572460.707387:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787572460.709883:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f42fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1874405268473856:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787572460.710204:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.710218:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712018:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712056:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572460.712062:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712074:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712286:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572460.712290:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787572460.712296:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712305:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437264 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712362:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712369:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712376:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712382:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572460.712385:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712391:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712413:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572460.712416:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787572460.712428:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc2 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712515:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc2 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712526:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc2 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.712590:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc2 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572460.712611:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268473984:192.168.204.55@tcp:105: 00000100:00100000:1.0:1787572460.714095:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4193240 going to sleep for 11 seconds 00000100:00100000:1.0:1787572460.725096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.725303:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244371584 00000100:00100000:0.0:1787572460.725318:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244371584 00000100:00100000:0.0:1787572460.725395:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:0.0:1787572460.725409:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11618:x1874405244371584:12345-192.168.204.55@tcp:49:lfs.0 00000100:00100000:0.0:1787572460.725676:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11618:x1874405244371584:12345-192.168.204.55@tcp:49:lfs.0 Request processed in 221us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572460.725687:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:2.0:1787572460.725932:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1874405268473984:192.168.204.55@tcp:105: 00010000:00010000:2.0:1787572460.725969:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.725983:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f4371a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726028:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726048:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726062:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726074:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726092:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726100:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726106:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572460.726112:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726130:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726146:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:2.0:1787572460.726150:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572460.726154:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726160:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f43726b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726172:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726177:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726183:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726188:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572460.726191:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726196:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726204:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:2.0:1787572460.726206:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787572460.726209:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.726226:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f43725d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572460.726542:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:11619:x1874405244371328:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 44152us (44768us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787572460.726553:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 230 00000020:00080000:2.0:1787572460.726558:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787572460.738822:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787572460.738848:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787572460.739893:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787572460.740275:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787572460.751171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.751233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572460.751246:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244371840 00000100:00100000:3.0:1787572460.751262:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244371840 00000100:00100000:3.0:1787572460.751349:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 231 00000100:00100000:3.0:1787572460.751364:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+23:11618:x1874405244371840:12345-192.168.204.55@tcp:58:lfs.0 00000100:00100000:2.0:1787572460.751377:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244372096 00000100:00100000:2.0:1787572460.751383:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244372096 00000100:00100000:2.0:1787572460.751422:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:2.0:1787572460.751440:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7480450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+24:11619:x1874405244372096:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1787572460.752149:0:7555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787572460.752263:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:11618:x1874405244371840:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 900us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572460.752273:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 231 00000004:00080000:2.0:1787572460.757407:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787572460.765552:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787572460.765740:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.765766:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.765780:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.765790:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.765796:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.765803:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.765865:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787572460.765950:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572460.765960:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.765977:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572460.765982:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.765991:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.766018:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d1c3a46000) 00010000:00010000:1.0:1787572460.766021:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787572460.766026:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.766033:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276800/0x9fe530ef4f437272 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.766052:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572460.766054:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7480450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:11619:x1874405244372096:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 14617us (14814us total) trans 4294967514 rc 0/0 00010000:00010000:1.0:1787572460.766054:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572460.766056:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572460.766066:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 62 00000020:00080000:2.0:1787572460.766074:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787572460.812573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572460.820058:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244372224 00000100:00100000:1.0:1787572460.820159:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244372224 00000100:00100000:1.0:1787572460.820274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 232 00000100:00100000:1.0:1787572460.820290:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f450ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+25:11621:x1874405244372224:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572460.820327:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572460.820363:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f437279 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbcfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.820929:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.820951:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.821043:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.821065:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.821169:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.821177:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.822149:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.822170:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.822181:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.822234:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.822255:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 26 pid: 5842 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572460.822274:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268474112:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572460.822438:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f41936c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572460.834720:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1874405268474112:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572460.834764:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572460.836731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572460.836855:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244372480 00000100:00100000:0.0:1787572460.836868:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244372480 00000100:00100000:0.0:1787572460.836951:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:0.0:1787572460.836965:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1ef3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:5593:x1874405244372480:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787572460.837314:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1ef3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:5593:x1874405244372480:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 349us (595us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787572460.837324:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:3.0:1787572460.846342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572460.847919:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244372608 00000100:00100000:2.0:1787572460.847939:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244372608 00010000:00010000:2.0:1787572460.848186:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 28 pid: 5842 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572460.848296:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:2.0:1787572460.848310:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:2353:x1874405244372608:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572460.848332:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572460.848341:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 28 pid: 5842 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.848358:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 28 pid: 5842 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.848407:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea800/0x9fe530ef4f437199 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcbb expref: 28 pid: 5842 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.848430:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:2.0:1787572460.848437:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.848468:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.848477:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572460.848519:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572460.848763:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848784:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572460.848846:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787572460.848852:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572460.848878:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848893:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848905:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848913:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848921:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848928:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572460.848933:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848942:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848954:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:1.0:1787572460.848957:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572460.848973:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.848991:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849007:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849014:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849020:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849025:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572460.849029:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849035:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849043:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d1d0b0b900) 00010000:00010000:1.0:1787572460.849046:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572460.849048:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849054:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f437287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849111:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f437279 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcfa expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849128:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcfa expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572460.849142:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572460.849145:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787572460.849148:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030200, rc 0) 00000100:00100000:1.0:1787572460.852056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f450ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:11621:x1874405244372224:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 31751us (39491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572460.853190:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 232 00000100:00100000:2.0:1787572460.853782:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:2353:x1874405244372608:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 5468us (7448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572460.853797:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:2.0:1787572461.040120:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268474368:0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.040210:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572461.040272:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f46e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268474880:0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.040296:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572461.040327:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787572461.040332:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f3e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268474240:0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.040361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572461.040383:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268474752:0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.040405:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572461.040436:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268474368 00000100:00100000:2.0:1787572461.040446:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268474368 00000100:00100000:2.0:1787572461.040502:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268474752 00000100:00100000:2.0:1787572461.040506:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268474752 00000100:00100000:2.0:1787572461.040546:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787572461.040556:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268474368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.040622:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268474368:12345-0@lo:400:kworker.0 Request processed in 67us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572461.040670:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787572461.040692:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787572461.040698:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268474752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.040729:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268474752:12345-0@lo:400:kworker.0 Request processed in 32us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572461.040735:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787572461.040757:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268474880 00000100:00100000:2.0:1787572461.040761:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268474880 00000100:00100000:2.0:1787572461.040789:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787572461.040796:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1874405268474880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.040827:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1874405268474880:12345-0@lo:400:kworker.0 Request processed in 32us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572461.040851:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787572461.040870:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268474240 00000100:00100000:2.0:1787572461.040874:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268474240 00000100:00100000:2.0:1787572461.040899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787572461.040906:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268474240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.040941:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268474240:12345-0@lo:400:kworker.0 Request processed in 35us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572461.040947:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:2.0:1787572461.040978:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572461.041020:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f3e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268474240:0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.041036:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268474752:0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.041045:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268474368:0@lo:400:kworker.0 00000100:00100000:2.0:1787572461.041064:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f46e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268474880:0@lo:400:kworker.0 00000100:00100000:1.0:1787572461.041272:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268474496:0@lo:400:kworker.0 00000100:00100000:1.0:1787572461.041308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572461.041335:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572461.041342:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268474624:0@lo:400:kworker.0 00000100:00100000:1.0:1787572461.041367:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572461.041401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268474496 00000100:00100000:1.0:1787572461.041406:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268474496 00000100:00100000:1.0:1787572461.041446:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787572461.041454:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268474496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572461.041492:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268474496:12345-0@lo:400:kworker.0 Request processed in 39us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572461.041499:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787572461.041523:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268474624 00000100:00100000:1.0:1787572461.041527:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268474624 00000100:00100000:1.0:1787572461.041557:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787572461.041563:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268474624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572461.041595:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268474624:12345-0@lo:400:kworker.0 Request processed in 32us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572461.041601:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787572461.041666:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787572461.041670:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572461.041692:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268474624:0@lo:400:kworker.0 00000100:00100000:1.0:1787572461.041703:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f43cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268474496:0@lo:400:kworker.0 00010000:00010000:3.0:1787572461.358973:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572461.556372:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572461.556407:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f415b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268475008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572461.556510:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572461.556727:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268475008 00000100:00100000:3.0:1787572461.556740:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268475008 00000100:00100000:3.0:1787572461.556816:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787572461.556828:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268475008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572461.556889:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787572461.556953:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268475008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572461.556961:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787572461.557073:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f415b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268475008:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787572461.745149:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787572461.745166:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787572461.745217:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787572461.745227:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787572461.747249:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268475136:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787572461.748213:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572461.766848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572461.769314:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d56680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874405268475136:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787572461.785075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244372736 00000100:00100000:1.0:1787572461.785098:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244372736 00000100:00100000:1.0:1787572461.785211:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 233 00000100:00100000:1.0:1787572461.785226:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11633:x1874405244372736:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787572461.785278:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787572461.785574:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11633:x1874405244372736:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 350us (18733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572461.785584:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 233 00000100:00080000:2.0:1787572461.786918:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572461.808305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572461.808833:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244372992 00000100:00100000:1.0:1787572461.808850:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244372992 00000100:00100000:1.0:1787572461.808931:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 234 00000100:00100000:1.0:1787572461.808945:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+26:11633:x1874405244372992:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572461.808975:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572461.809004:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437295 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd01 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.809157:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43729c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.809175:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43729c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.809190:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43729c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572461.809221:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787572461.809407:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f437295 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd01 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.809433:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43729c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd01 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.809443:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572461.809446:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787572461.809451:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030600, rc 0) 00000100:00100000:1.0:1787572461.809535:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:11633:x1874405244372992:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 593us (1247us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787572461.809544:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 234 00000100:00100000:2.0:1787572461.820382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572461.820439:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244373120 00000100:00100000:2.0:1787572461.820453:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244373120 00000100:00100000:2.0:1787572461.820533:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1787572461.820557:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:2353:x1874405244373120:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572461.820578:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572461.820622:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030600/0x9fe530ef4f43729c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd01 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572461.820670:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:2.0:1787572461.820677:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572461.820747:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:2353:x1874405244373120:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 203us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572461.820756:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1787572461.835705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572461.835922:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244373376 00000100:00100000:1.0:1787572461.835937:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244373376 00000100:00100000:1.0:1787572461.836036:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 235 00000100:00100000:1.0:1787572461.836051:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+27:11633:x1874405244373376:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787572461.836182:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836205:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836220:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836516:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836540:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836547:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836552:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572461.836558:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836566:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836581:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572461.836584:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787572461.836589:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572461.836596:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031e00/0x9fe530ef4f4372aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572461.837239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:11633:x1874405244373376:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 1185us (1544us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787572461.837250:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 235 00000040:00080000:3.0:1787572461.837537:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787572461.837543:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572461.838394:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787572461.838407:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787572461.848779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572461.849125:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244373632 00000100:00100000:1.0:1787572461.849144:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244373632 00000100:00100000:1.0:1787572461.849228:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:1.0:1787572461.849244:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+28:11633:x1874405244373632:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787572461.849670:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:11633:x1874405244373632:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 428us (909us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787572461.849689:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:0.0:1787572461.889314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572461.889390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572461.889428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572461.889484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572461.889520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244373760 00000100:00100000:0.0:1787572461.889532:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244373760 00000100:00100000:0.0:1787572461.889593:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 303 00000100:00100000:0.0:1787572461.889605:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244373760:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572461.889733:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244373760:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572461.889741:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 303 00000100:00100000:0.0:1787572461.889857:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244373888 00000100:00100000:0.0:1787572461.889861:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244373888 00000100:00100000:0.0:1787572461.889903:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244374016 00000100:00100000:0.0:1787572461.889906:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244374016 00000100:00100000:0.0:1787572461.889930:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:0.0:1787572461.889937:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244373888:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572461.889974:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244373888:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 38us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572461.889981:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:0.0:1787572461.889993:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00100000:0.0:1787572461.889999:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244374016:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572461.890025:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244374016:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572461.890031:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00080000:0.0:1787572461.890216:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787572461.891086:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244374144 00000100:00100000:3.0:1787572461.891099:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244374144 00000100:00100000:3.0:1787572461.891203:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 174 00000100:00100000:3.0:1787572461.891214:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d09cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244374144:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572461.891296:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d09cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244374144:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 84us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572461.891303:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 174 00000100:00080000:0.0:1787572461.892227:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572462.063263:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572462.063300:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268475264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572462.063407:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572462.063549:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268475264 00000100:00100000:0.0:1787572462.063561:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268475264 00000100:00100000:0.0:1787572462.063680:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787572462.063695:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268475264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572462.063748:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572462.063833:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268475264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572462.063841:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787572462.063915:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268475264:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787572462.333514:0:12581:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787572462.333530:0:12581:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787572462.333597:0:12581:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787572462.334041:0:12581:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787572462.389936:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572462.576154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572462.576245:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244374400 00000100:00100000:1.0:1787572462.576259:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244374400 00000100:00100000:1.0:1787572462.576336:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 236 00000100:00100000:1.0:1787572462.576361:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+29:11646:x1874405244374400:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572462.576398:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572462.576431:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4372b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd08 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.576578:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4372b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.576607:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4372b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.576621:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4372b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572462.576665:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787572462.576821:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031800/0x9fe530ef4f4372b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd08 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.576842:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4372b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd08 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.576853:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572462.576856:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787572462.576859:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030e00, rc 0) 00000100:00100000:1.0:1787572462.576948:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11646:x1874405244374400:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 601us (814us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787572462.576957:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 236 00000100:00100000:3.0:1787572462.582282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572462.582379:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244374528 00000100:00100000:1.0:1787572462.582393:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244374528 00000100:00100000:1.0:1787572462.582471:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 237 00000100:00100000:1.0:1787572462.582484:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11646:x1874405244374528:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1787572462.582578:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582610:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582625:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582891:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582900:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582908:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582914:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0031000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572462.582921:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582929:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582959:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:1.0:1787572462.582962:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572462.582969:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572462.582975:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0031000/0x9fe530ef4f4372c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572462.583295:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+31:11646:x1874405244374528:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 810us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572462.583304:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 237 00000100:00100000:3.0:1787572462.701408:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572462.701695:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244374656 00000100:00100000:2.0:1787572462.701709:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244374656 00000100:00100000:2.0:1787572462.701793:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00100000:2.0:1787572462.701806:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2355:x1874405244374656:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:2.0:1787572462.701828:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572462.701856:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f4372cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd0f expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787572462.701891:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c30e9, atime: 0x6a8c30e9, ctime: 0x6a8c30e9, blocks: 0xb 00010000:00010000:2.0:1787572462.701917:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=392s v=(0 0) 00010000:00010000:2.0:1787572462.701923:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572462.701935:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f4372cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd0f expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572462.701957:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f4372cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd0f expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572462.701974:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276400, rc 0) 00000100:00100000:2.0:1787572462.702074:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2355:x1874405244374656:12345-192.168.204.55@tcp:101:cat.0 Request processed in 264us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572462.702082:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00080000:1.0:1787572462.702284:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787572462.714050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572462.716502:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244374784 00000100:00100000:2.0:1787572462.716522:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244374784 00002000:00100000:2.0:1787572462.716620:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98d1f415b100 x1874405244374784/t0(0) o3->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:498/0 lens 488/0 e 0 to 0 dl 1787572473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572462.716695:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f415b100 with x1874405244374784 ext(0->4095) 00002000:00010000:2.0:1787572462.716704:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f415b100 00000100:00100000:2.0:1787572462.716757:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1787572462.716770:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f415b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2356:x1874405244374784:12345-192.168.204.55@tcp:3:cat.0 00000100:00100000:2.0:1787572462.722406:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f415b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+8:2356:x1874405244374784:12345-192.168.204.55@tcp:3:cat.0 Request processed in 5616us (8349us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787572462.722428:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00002000:00100000:2.0:1787572462.722449:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98d1f415b100 x1874405244374784/t0(0) o3->6d499b5b-e864-4e70-bf3c-7c3a42e124cd@192.168.204.55@tcp:498/0 lens 488/4536 e 0 to 0 dl 1787572473 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787572462.722461:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d1f415b100 with x1874405244374784 ext(0->4095) 00002000:00010000:2.0:1787572462.722469:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d1f415b100 00010000:00010000:3.0:1787572463.406964:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572464.433597:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787572464.698910:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:3.0:1787572464.943675:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787572464.943684:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572464.943735:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787572464.943742:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787572465.454886:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787572465.728123:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:1.0:1787572465.728144:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787572465.728163:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d1f4193a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787572465.728168:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1f44d0500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d1f4193f00 00000020:00080000:1.0:1787572465.728172:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d1f44d0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d1d0adfc00 00000020:00080000:1.0:1787572465.728208:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787572465.728334:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787572465.728531:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1787572465.754729:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1787572465.754749:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1787572465.754757:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:3.0:1787572466.163779:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268475392:0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.163861:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572466.163958:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268475392 00000100:00100000:0.0:1787572466.163967:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268475392 00000100:00100000:3.0:1787572466.164126:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572466.164134:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268475520:0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.164165:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572466.164195:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268475520 00000100:00100000:3.0:1787572466.164199:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268475520 00000100:00100000:3.0:1787572466.164243:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787572466.164253:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268475520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.164303:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268475520:12345-0@lo:400:kworker.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572466.164309:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787572466.164350:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268475520:0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.164748:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268475648:0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.164777:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572466.164846:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572466.164852:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268475776:0@lo:400:kworker.0 00000100:00100000:0.0:1787572466.164878:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787572466.164879:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572466.164887:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268475392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.164906:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268475648 00000100:00100000:3.0:1787572466.164911:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268475648 00000100:00100000:0.0:1787572466.164929:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268475392:12345-0@lo:400:kworker.0 Request processed in 44us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572466.164936:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787572466.164944:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787572466.164957:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268475648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.165126:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268475648:12345-0@lo:400:kworker.0 Request processed in 169us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572466.165132:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787572466.165153:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268475776 00000100:00100000:3.0:1787572466.165158:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268475776 00000100:00100000:3.0:1787572466.165187:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787572466.165194:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268475776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.165301:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268475776:12345-0@lo:400:kworker.0 Request processed in 107us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572466.165309:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1787572466.165326:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787572466.165330:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572466.166346:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787572466.166357:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d0c5d54a80, transno 4294967310 00000100:00100000:0.0:1787572466.166375:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268475776:0@lo:400:kworker.0 00000100:00100000:0.0:1787572466.166390:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268475648:0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.169536:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268475392:0@lo:400:kworker.0 00000100:00100000:1.0:1787572466.170737:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268476032:0@lo:400:kworker.0 00000100:00100000:1.0:1787572466.170805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572466.170846:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572466.170853:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268475904:0@lo:400:kworker.0 00000100:00100000:1.0:1787572466.170882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572466.170916:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268476032 00000100:00100000:1.0:1787572466.170923:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268476032 00000100:00100000:1.0:1787572466.171001:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787572466.171097:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268476032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572466.171153:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268476032:12345-0@lo:400:kworker.0 Request processed in 60us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572466.171160:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787572466.171201:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787572466.171206:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d0c5d57100, transno 4294967322 00000004:00080000:1.0:1787572466.171215:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787572466.171602:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268476032:0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.171780:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268475904 00000100:00100000:3.0:1787572466.171787:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268475904 00000100:00100000:3.0:1787572466.171832:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787572466.171841:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268475904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572466.171892:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268475904:12345-0@lo:400:kworker.0 Request processed in 52us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572466.171899:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787572466.171929:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268475904:0@lo:400:kworker.0 00000100:00080000:0.0:1787572466.172591:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787572466.172598:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787572466.486760:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572466.672327:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1d0b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268476160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572466.672405:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572466.672660:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268476160 00000100:00100000:3.0:1787572466.672668:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268476160 00000100:00100000:3.0:1787572466.672740:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787572466.672752:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268476160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572466.672812:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572466.672870:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268476160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572466.672878:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787572466.673149:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1d0b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268476160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572467.008741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572467.008793:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572467.008845:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244375040 00000100:00100000:2.0:1787572467.008858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572467.008866:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244375040 00000100:00100000:3.0:1787572467.008975:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 178 00000100:00100000:2.0:1787572467.008984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572467.008997:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:2353:x1874405244375040:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572467.009031:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572467.009074:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244375296 00000100:00100000:2.0:1787572467.009085:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244375296 00000100:00100000:3.0:1787572467.009129:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:2353:x1874405244375040:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 139us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572467.009141:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 178 00000100:00100000:2.0:1787572467.009161:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244375168 00000100:00100000:3.0:1787572467.009168:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244375424 00000100:00100000:2.0:1787572467.009168:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244375168 00000100:00100000:3.0:1787572467.009177:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244375424 00000100:00100000:3.0:1787572467.009221:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 179 00000100:00100000:3.0:1787572467.009231:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244375424:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572467.009240:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:2.0:1787572467.009259:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244375296:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572467.009455:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:0.0:1787572467.009467:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244375168:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572467.009482:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+5:2353:x1874405244375424:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 246us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572467.009494:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 179 00000100:00100000:2.0:1787572467.009569:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244375296:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 314us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572467.009580:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00080000:2.0:1787572467.009697:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787572467.009701:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787572467.009704:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572467.011950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244374912 00000100:00100000:1.0:1787572467.011974:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244374912 00000100:00100000:1.0:1787572467.012058:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 305 00000100:00100000:1.0:1787572467.012069:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244374912:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572467.012152:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244374912:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 84us (3299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572467.012161:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 305 00000100:00100000:0.0:1787572467.012475:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244375168:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 3009us (3491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572467.012486:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:1.0:1787572467.182956:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268476288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572467.183047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572467.183279:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268476288 00000100:00100000:0.0:1787572467.183288:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268476288 00000100:00100000:0.0:1787572467.183343:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787572467.183354:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268476288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572467.183391:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572467.183451:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268476288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572467.183458:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787572467.184035:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268476288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787572467.506543:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572468.470844:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572468.472120:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244375552 00000100:00100000:3.0:1787572468.472144:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244375552 00000100:00100000:3.0:1787572468.473357:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 238 00000100:00100000:3.0:1787572468.473388:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:11307:x1874405244375552:12345-192.168.204.55@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787572468.473713:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:11307:x1874405244375552:12345-192.168.204.55@tcp:60:lhsmtool_posix.0 Request processed in 328us (2865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572468.473731:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 238 00000100:00100000:3.0:1787572468.490549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572468.491320:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244375808 00000100:00100000:1.0:1787572468.491340:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244375808 00000100:00100000:1.0:1787572468.491488:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:1.0:1787572468.491502:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:11307:x1874405244375808:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787572468.493304:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:11307:x1874405244375808:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1794us (2760us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787572468.493330:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00010000:00010000:2.0:1787572468.530519:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572468.833985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572468.834269:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244375936 00000100:00100000:0.0:1787572468.834286:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244375936 00000100:00100000:0.0:1787572468.834369:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 239 00000100:00100000:0.0:1787572468.834382:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+5:12099:x1874405244375936:12345-192.168.204.55@tcp:101:lsof.0 00010000:00010000:0.0:1787572468.834404:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572468.834432:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4372d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd16 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572468.834533:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4372db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572468.834620:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4372db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572468.834676:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4372db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572468.834906:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787572468.834910:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572468.834993:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4372db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572468.835207:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670600/0x9fe530ef4f4372d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd16 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572468.835230:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4372db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd16 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572468.835242:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:0.0:1787572468.835245:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572468.835249:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670800, rc 0) 00000100:00100000:0.0:1787572468.835331:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fbce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+6:12099:x1874405244375936:12345-192.168.204.55@tcp:101:lsof.0 Request processed in 952us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572468.835339:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 239 00010000:00010000:3.0:1787572469.551032:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572470.575947:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787572470.847111:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787572470.847132:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787572470.847203:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787572470.847214:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1787572471.279345:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268476672:0@lo:400:kworker.0 00000100:00100000:3.0:1787572471.279350:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268476416:0@lo:400:kworker.0 00000100:00100000:1.0:1787572471.279411:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268476544:0@lo:400:kworker.0 00000100:00100000:3.0:1787572471.286088:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572471.286160:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268476928:0@lo:400:kworker.0 00000100:00100000:2.0:1787572471.286357:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572471.286400:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572471.286409:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268476800:0@lo:400:kworker.0 00000100:00100000:2.0:1787572471.286450:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572471.286655:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268476800 00000100:00100000:2.0:1787572471.286663:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268476800 00000100:00100000:2.0:1787572471.286726:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787572471.286737:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268476800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572471.286793:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268476800:12345-0@lo:400:kworker.0 Request processed in 58us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572471.286801:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1787572471.286822:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572471.286855:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268476800:0@lo:400:kworker.0 00000100:00100000:2.0:1787572471.286892:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268476672 00000100:00100000:2.0:1787572471.286897:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268476672 00000100:00100000:2.0:1787572471.286948:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787572471.286956:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268476672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572471.286992:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268476672:12345-0@lo:400:kworker.0 Request processed in 38us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572471.286999:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1787572471.287012:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572471.287030:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268476672:0@lo:400:kworker.0 00000100:00100000:0.0:1787572471.288079:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268476416 00000100:00100000:0.0:1787572471.288091:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268476416 00000100:00100000:0.0:1787572471.288136:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787572471.288144:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268476416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572471.288214:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268476416:12345-0@lo:400:kworker.0 Request processed in 71us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572471.288221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787572471.289935:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572471.289986:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268477056:0@lo:400:kworker.0 00000100:00100000:1.0:1787572471.290021:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572471.290077:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268477056 00000100:00100000:1.0:1787572471.290084:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268477056 00000100:00100000:1.0:1787572471.290136:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1787572471.290138:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787572471.290146:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268477056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572471.290210:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268477056:12345-0@lo:400:kworker.0 Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572471.290217:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787572471.290666:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268476544 00000100:00100000:0.0:1787572471.290672:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268476544 00000100:00100000:0.0:1787572471.290702:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787572471.290713:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268477056:0@lo:400:kworker.0 00000100:00100000:0.0:1787572471.290733:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268476544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572471.290796:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268476544:12345-0@lo:400:kworker.0 Request processed in 64us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572471.290803:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787572471.291312:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268476544:0@lo:400:kworker.0 00000100:00100000:3.0:1787572471.302498:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572471.302794:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268476416:0@lo:400:kworker.0 00000100:00100000:2.0:1787572471.309014:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268476928 00000100:00100000:2.0:1787572471.309031:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268476928 00000100:00100000:2.0:1787572471.309124:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787572471.309135:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268476928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572471.309232:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268476928:12345-0@lo:400:kworker.0 Request processed in 99us (6741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572471.309239:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1787572471.309318:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572471.309495:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268476928:0@lo:400:kworker.0 00010000:00010000:3.0:1787572471.601691:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572471.792148:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787572471.792185:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268477184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572471.792289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572471.793067:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268477184 00000100:00100000:3.0:1787572471.793082:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268477184 00000100:00100000:3.0:1787572471.793175:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787572471.793188:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268477184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572471.793241:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572471.793322:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268477184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572471.793330:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787572471.793506:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268477184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572472.130775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572472.130825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572472.130856:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572472.130903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572472.130933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572472.130970:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244376320 00000100:00100000:2.0:1787572472.130986:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244376320 00000100:00100000:2.0:1787572472.131066:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244376448 00000100:00100000:2.0:1787572472.131080:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244376448 00000100:00100000:2.0:1787572472.131107:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 112 00000100:00100000:2.0:1787572472.131120:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244376320:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572472.131236:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2353:x1874405244376320:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 119us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572472.131245:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 112 00000100:00100000:2.0:1787572472.131266:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:2.0:1787572472.131273:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244376448:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572472.131300:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2353:x1874405244376448:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572472.131306:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:2.0:1787572472.131325:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244376576 00000100:00100000:2.0:1787572472.131328:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244376576 00000100:00100000:2.0:1787572472.131357:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244376192 00000100:00100000:2.0:1787572472.131360:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244376192 00000100:00100000:2.0:1787572472.131384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 183 00000100:00100000:2.0:1787572472.131391:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2353:x1874405244376576:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572472.131451:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2353:x1874405244376576:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 60us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572472.131458:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 183 00000100:00100000:2.0:1787572472.131470:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 184 00000100:00100000:2.0:1787572472.131477:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f46e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:2353:x1874405244376192:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572472.131508:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f46e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:2353:x1874405244376192:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572472.131514:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 184 00000100:00080000:2.0:1787572472.131547:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787572472.131552:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787572472.131554:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572472.132662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244376064 00000100:00100000:0.0:1787572472.132675:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244376064 00000100:00100000:0.0:1787572472.132730:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 307 00000100:00100000:0.0:1787572472.132740:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244376064:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572472.132809:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46025283-1dc6-4449-aad9-047e59682663+13:2353:x1874405244376064:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 70us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572472.132817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 307 00000100:00100000:2.0:1787572472.303844:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268477312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572472.306054:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572472.306546:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268477312 00000100:00100000:3.0:1787572472.306559:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268477312 00000100:00100000:3.0:1787572472.306742:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787572472.306756:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268477312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787572472.306821:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572472.306923:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268477312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572472.306931:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787572472.307007:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268477312:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787572472.565504:0:12785:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:54:29 (1787572469) 00010000:00010000:2.0:1787572472.622797:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572473.652973:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787572474.161123:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787572474.161140:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787572474.164884:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787572474.164903:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787572474.671837:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572475.695108:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572476.399700:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268477824:0@lo:400:kworker.0 00000100:00100000:2.0:1787572476.399774:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572476.399846:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572476.399853:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268477696:0@lo:400:kworker.0 00000100:00100000:2.0:1787572476.399903:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572476.399943:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268477824 00000100:00100000:2.0:1787572476.399951:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268477824 00000100:00100000:2.0:1787572476.400009:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787572476.400019:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268477824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400171:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268477568:0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400204:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572476.400225:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268478080:0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572476.400268:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787572476.400274:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268477440:0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572476.400345:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f419bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268477952:0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400369:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572476.400417:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268478080 00000100:00100000:1.0:1787572476.400421:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268478080 00000100:00100000:1.0:1787572476.400453:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787572476.400460:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268478080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400498:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268478080:12345-0@lo:400:kworker.0 Request processed in 38us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572476.400505:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1787572476.400526:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787572476.400530:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787572476.400538:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268477696 00000100:00100000:1.0:1787572476.400542:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268477696 00000100:00100000:1.0:1787572476.400569:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268477568 00000100:00100000:1.0:1787572476.400572:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268477568 00000100:00100000:1.0:1787572476.400584:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268477952 00000100:00100000:1.0:1787572476.400586:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268477952 00000100:00100000:1.0:1787572476.400599:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787572476.400605:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268477696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400662:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268477696:12345-0@lo:400:kworker.0 Request processed in 56us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572476.400668:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787572476.400682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787572476.400688:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268477568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400716:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268477568:12345-0@lo:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572476.400722:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787572476.400733:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787572476.400747:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268477952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400776:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268477952:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572476.400782:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1787572476.400802:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572476.400831:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268477952:0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400841:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268477568:0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400849:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f419aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268478080:0@lo:400:kworker.0 00000100:00100000:1.0:1787572476.400897:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268477696:0@lo:400:kworker.0 00000100:00100000:0.0:1787572476.401344:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268477440 00000100:00100000:0.0:1787572476.401350:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268477440 00000100:00100000:0.0:1787572476.401392:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787572476.401400:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268477440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572476.401447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3311:x1874405268477440:12345-0@lo:400:kworker.0 Request processed in 49us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572476.401462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787572476.401500:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d30d720-8336-413c-aa2f-3c1df9a74652:3311:1874405268477440:0@lo:400:kworker.0 00000100:00100000:2.0:1787572476.401595:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268477824:12345-0@lo:400:kworker.0 Request processed in 1576us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572476.401602:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787572476.408664:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268477824:0@lo:400:kworker.0 00010000:00010000:2.0:1787572476.719228:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572476.912943:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268478208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572476.913016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572476.913343:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268478208 00000100:00100000:2.0:1787572476.913352:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268478208 00000100:00100000:2.0:1787572476.913410:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787572476.913420:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268478208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572476.913457:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572476.913524:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268478208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572476.913531:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787572476.913951:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268478208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572477.013916:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572477.014012:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244376832 00000100:00100000:1.0:1787572477.014022:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244376832 00000100:00100000:1.0:1787572477.014092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:1.0:1787572477.014104:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+18:12320:x1874405244376832:12345-192.168.204.55@tcp:35:umount.0 00000100:00100000:1.0:1787572477.014746:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:12320:x1874405244376832:12345-192.168.204.55@tcp:35:umount.0 Request processed in 642us (836us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787572477.014755:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00080000:2.0:1787572477.016054:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572477.017305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572477.017600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244377088 00000100:00100000:2.0:1787572477.017610:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244377088 00000100:00100000:2.0:1787572477.017697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:2.0:1787572477.017708:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+19:12320:x1874405244377088:12345-192.168.204.55@tcp:35:umount.0 00000100:00100000:2.0:1787572477.018068:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:12320:x1874405244377088:12345-192.168.204.55@tcp:35:umount.0 Request processed in 360us (766us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787572477.018076:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:3.0:1787572477.020286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572477.020620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244377344 00000100:00100000:2.0:1787572477.020630:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244377344 00000100:00100000:2.0:1787572477.020713:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:2.0:1787572477.020734:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c7483050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+20:12320:x1874405244377344:12345-192.168.204.55@tcp:35:umount.0 00000100:00100000:2.0:1787572477.021980:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c7483050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:12320:x1874405244377344:12345-192.168.204.55@tcp:35:umount.0 Request processed in 1244us (1696us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787572477.021990:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:3.0:1787572477.027903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572477.028960:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244377600 00000100:00100000:1.0:1787572477.028971:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244377600 00000100:00100000:1.0:1787572477.029134:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:1.0:1787572477.029146:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:12320:x1874405244377600:12345-192.168.204.55@tcp:35:umount.0 00000100:00100000:1.0:1787572477.029564:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:12320:x1874405244377600:12345-192.168.204.55@tcp:35:umount.0 Request processed in 420us (1670us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787572477.029587:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:0.0:1787572477.041050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572477.041091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572477.041114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572477.041163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572477.041373:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244377984 00000100:00100000:1.0:1787572477.041384:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244377984 00000100:00100000:1.0:1787572477.041462:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:1.0:1787572477.041474:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+7:2352:x1874405244377984:12345-192.168.204.55@tcp:9:umount.0 00000020:00000080:1.0:1787572477.041508:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43688c 00000020:00010000:1.0:1787572477.041516:0:6690:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d1de1f4000: total 0 00000100:00080000:1.0:1787572477.041520:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d1c8aa4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787572477.041561:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787572477.041880:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2352:x1874405244377984:12345-192.168.204.55@tcp:9:umount.0 Request processed in 407us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572477.041888:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 74 00000020:00010000:1.0:1787572477.041910:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d1de1f4000: total 0 00010000:00010000:1.0:1787572477.041932:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d1de1f4000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787572477.041993:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a898c5/0x9fe530ef4f4372cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd0f expref: 4 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572477.042027:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11eccb5/0x9fe530ef4f436c28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb41 expref: 3 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572477.042043:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d1de1f4000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787572477.042055:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572477.042057:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572477.042060:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787572477.042302:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787572477.042419:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244378112 00000100:00100000:3.0:1787572477.042425:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244378112 00000100:00100000:3.0:1787572477.042474:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244378368 00000100:00100000:3.0:1787572477.042478:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244378368 00000100:00100000:3.0:1787572477.042491:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244378240 00000100:00100000:3.0:1787572477.042494:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244378240 00000100:00100000:3.0:1787572477.042508:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:3.0:1787572477.042516:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+15:2355:x1874405244378112:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572477.042527:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572477.042539:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c9200/0x9fe530ef4f436322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8a1 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.042550:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572477.042572:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+14:2355:x1874405244378112:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 58us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572477.042578:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:3.0:1787572477.042592:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:3.0:1787572477.042598:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+13:2355:x1874405244378368:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572477.042605:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572477.042613:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc277000/0x9fe530ef4f436536 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db96c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.042622:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572477.042677:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+12:2355:x1874405244378368:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 78us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572477.042683:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:3.0:1787572477.042710:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:3.0:1787572477.042716:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+11:2355:x1874405244378240:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572477.042724:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572477.042733:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a30000/0x9fe530ef4f4362b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db869 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.042742:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572477.042759:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+10:2355:x1874405244378240:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 43us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572477.043472:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:3.0:1787572477.047862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572477.047948:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244378496 00000100:00100000:0.0:1787572477.047959:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244378496 00000100:00100000:0.0:1787572477.048038:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:0.0:1787572477.048050:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+5:2352:x1874405244378496:12345-192.168.204.55@tcp:9:umount.0 00000020:00000080:0.0:1787572477.048085:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436cd0 00000100:00080000:0.0:1787572477.048094:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98d1c2da8000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787572477.048169:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1787572477.048295:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787572477.048605:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+2:2352:x1874405244378496:12345-192.168.204.55@tcp:9:umount.0 Request processed in 556us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572477.048613:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00010000:00010000:1.0:1787572477.051871:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572477.064399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572477.064562:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244379520 00000100:00100000:1.0:1787572477.064597:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244379520 00000100:00100000:1.0:1787572477.064694:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 240 00000100:00100000:1.0:1787572477.064704:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+22:2352:x1874405244379520:12345-192.168.204.55@tcp:39:umount.0 00000020:00000080:1.0:1787572477.064738:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4362c0 00000020:00010000:1.0:1787572477.064755:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d1cdf1d000: total 0 00000100:00080000:1.0:1787572477.064760:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98d1fbda3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787572477.064792:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1787572477.065150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d499b5b-e864-4e70-bf3c-7c3a42e124cd+21:2352:x1874405244379520:12345-192.168.204.55@tcp:39:umount.0 Request processed in 446us (761us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787572477.065158:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 240 00000020:00010000:3.0:1787572477.065489:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d1cdf1d000: total 0 00010000:00010000:3.0:1787572477.065494:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572477.065532:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d1cdf1d000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787572477.065569:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:3.0:1787572477.065572:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787572477.065581:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671600/0x9fe530ef4f436ca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb64 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065600:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572477.065602:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572477.065606:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f436b09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbaf4 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065619:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572477.065621:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787572477.065624:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276000/0x9fe530ef4f4365fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db996 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065704:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572477.065707:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572477.065712:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4371ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcc2 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065728:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572477.065731:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572477.065734:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030200/0x9fe530ef4f43728e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbcfa expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065749:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:3.0:1787572477.065752:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787572477.065755:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f436c8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb5d expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065768:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1c577c400) 00010000:00010000:3.0:1787572477.065771:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572477.065775:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea000/0x9fe530ef4f4365a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db981 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065793:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572477.065795:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572477.065799:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277a00/0x9fe530ef4f436be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb2c expref: 13 pid: 7555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065812:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d1e1353200) 00010000:00010000:3.0:1787572477.065814:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787572477.065825:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670e00/0x9fe530ef4f43658a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db97a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065844:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572477.065847:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787572477.065851:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f436c13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbb3a expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065866:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d1e1353a00) 00010000:00010000:3.0:1787572477.065868:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787572477.065872:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463400/0x9fe530ef4f436f8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbc36 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065888:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d1c577c000) 00010000:00010000:3.0:1787572477.065891:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787572477.065894:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c0030e00/0x9fe530ef4f4372b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd08 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065908:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d1c3a46c00) 00010000:00010000:3.0:1787572477.065911:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787572477.065914:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4368e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dba68 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572477.065927:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d1cdf1d000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787572477.065939:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572477.065941:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572477.065943:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572477.247747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572477.247850:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244379648 00000100:00100000:3.0:1787572477.247861:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244379648 00000100:00100000:3.0:1787572477.247948:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00100000:3.0:1787572477.247960:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2353:x1874405244379648:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572477.248045:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2353:x1874405244379648:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572477.248052:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00080000:2.0:1787572477.248413:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572477.423080:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572477.423110:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268478336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572477.423205:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572477.423473:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268478336 00000100:00100000:0.0:1787572477.423482:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268478336 00000100:00100000:0.0:1787572477.423533:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787572477.423557:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268478336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787572477.423593:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572477.423675:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268478336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572477.423682:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787572477.424005:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268478336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787572477.744928:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572478.766824:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572479.610548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572479.610603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572479.610676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572479.610692:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244379776 00000100:00100000:2.0:1787572479.610703:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244379776 00000100:00100000:2.0:1787572479.610769:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244380032 00000100:00100000:2.0:1787572479.610773:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244380032 00000100:00100000:2.0:1787572479.610815:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244379904 00000100:00100000:2.0:1787572479.610818:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244379904 00000100:00100000:2.0:1787572479.610837:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1787572479.610847:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+12:2356:x1874405244379776:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572479.610862:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572479.610882:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f436392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8b6 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572479.610900:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572479.610950:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+11:2356:x1874405244379776:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 104us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572479.610958:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1787572479.610975:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1787572479.610981:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+10:2356:x1874405244380032:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572479.610989:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572479.610999:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f43652f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db965 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572479.611002:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00010000:00010000:2.0:1787572479.611008:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572479.611012:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46025283-1dc6-4449-aad9-047e59682663+9:2356:x1874405244379904:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787572479.611020:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787572479.611026:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46025283-1dc6-4449-aad9-047e59682663+9:2356:x1874405244380032:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 46us (423us total) trans 0 rc 0/0 00010000:00010000:3.0:1787572479.611030:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0eb800/0x9fe530ef4f436399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8e0 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572479.611032:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00010000:00010000:3.0:1787572479.611039:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572479.611057:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46025283-1dc6-4449-aad9-047e59682663+7:2356:x1874405244379904:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 48us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572479.611063:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:1.0:1787572479.631311:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572479.631689:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244380288 00000100:00100000:2.0:1787572479.631701:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244380288 00000100:00100000:2.0:1787572479.631786:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 241 00000100:00100000:2.0:1787572479.631798:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+6:2352:x1874405244380288:12345-192.168.204.55@tcp:39:umount.0 00000020:00000080:2.0:1787572479.631839:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4363a7 00000020:00010000:2.0:1787572479.631861:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d1cdf1c800: total 0 00000100:00080000:2.0:1787572479.631876:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf1c000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787572479.631894:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:2.0:1787572479.631918:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1787572479.631954:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d1cdf1c800: total 0 00010000:00010000:3.0:1787572479.632005:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d1cdf1c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787572479.632045:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0b0b200) 00010000:00010000:3.0:1787572479.632049:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787572479.632058:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4670800/0x9fe530ef4f4372db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd16 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572479.632083:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d1cdf1c800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787572479.632098:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572479.632100:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572479.632103:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572479.632185:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d6322bb-3191-4d60-88a3-6866da8333ec+3:2352:x1874405244380288:12345-192.168.204.55@tcp:39:umount.0 Request processed in 389us (883us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787572479.632193:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 241 00000100:00100000:2.0:1787572479.662700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572479.663426:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244380544 00000100:00100000:0.0:1787572479.663437:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244380544 00000100:00100000:0.0:1787572479.663513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 309 00000100:00100000:0.0:1787572479.663524:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+7:2352:x1874405244380544:12345-192.168.204.55@tcp:251:umount.0 00000020:00000080:0.0:1787572479.663572:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43629d 00000020:00010000:0.0:1787572479.663580:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d0c52f0000: total 0 00000100:00080000:0.0:1787572479.663585:0:5835:0:(import.c:65:import_set_state_nolock()) ffff98d0c52f5000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787572479.663695:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46025283-1dc6-4449-aad9-047e59682663+3:2352:x1874405244380544:12345-192.168.204.55@tcp:251:umount.0 Request processed in 173us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572479.663703:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 309 00000020:00010000:3.0:1787572479.664146:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d0c52f0000: total 0 00010000:00010000:3.0:1787572479.664151:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572479.664193:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d0c52f0000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787572479.664223:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8800/0x9fe530ef4f436353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151db8a8 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572479.664238:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d0c52f0000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787572479.664247:0:5831:0:(genops.c:885:class_export_put()) final put ffff98d0c52f0000/46025283-1dc6-4449-aad9-047e59682663 00010000:00010000:3.0:1787572479.664275:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572479.664277:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572479.664279:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787572479.664345:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c52f0000/46025283-1dc6-4449-aad9-047e59682663 for MGS 00000020:00000080:2.0:1787572479.664390:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c52f5000 for MGS 00010000:00010000:3.0:1787572479.791745:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787572480.031796:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:2.0:1787572480.031806:0:6719:0:(genops.c:885:class_export_put()) final put ffff98d1c2daa000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:2.0:1787572480.031833:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1c2daa000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd for lustre-OST0000 00000020:00000080:2.0:1787572480.031885:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1c2da8000 for lustre-OST0000 00010000:00010000:3.0:1787572480.815817:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787572481.066941:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000001:00080000:0.0:1787572481.066969:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1787572481.066981:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d6322bb-3191-4d60-88a3-6866da8333ec 00000001:00080000:0.0:1787572481.066988:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787572481.066991:0:5864:0:(genops.c:885:class_export_put()) final put ffff98d1cdf1c800/6d6322bb-3191-4d60-88a3-6866da8333ec 00000020:00000080:0.0:1787572481.067013:0:5864:0:(genops.c:885:class_export_put()) final put ffff98d1cdf1d000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:3.0:1787572481.067120:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cdf1c800/6d6322bb-3191-4d60-88a3-6866da8333ec for lustre-MDT0000 00000020:00000080:3.0:1787572481.067182:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cdf1d000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd for lustre-MDT0000 00000020:00000080:3.0:1787572481.067213:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1cdf1c000 for lustre-MDT0000 00000020:00000080:3.0:1787572481.067218:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1fbda3000 for lustre-MDT0000 00000001:00100000:3.0:1787572481.083109:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:3.0:1787572481.083121:0:7653:0:(genops.c:885:class_export_put()) final put ffff98d1de1f4000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd 00000020:00000080:2.0:1787572481.083190:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1de1f4000/6d499b5b-e864-4e70-bf3c-7c3a42e124cd for lustre-OST0001 00000020:00000080:2.0:1787572481.084448:0:473:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1c8aa4800 for lustre-OST0001 00000100:00100000:3.0:1787572481.520861:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268478464:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.520947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572481.520994:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268478976:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.521023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572481.521048:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787572481.521054:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268478592:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.521076:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572481.521092:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268479104:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.521129:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572481.521157:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268478720:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.521181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572481.521197:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787572481.521203:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268478848:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.521222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572481.521266:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268478464 00000100:00100000:3.0:1787572481.521274:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268478464 00000100:00100000:3.0:1787572481.521338:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787572481.521347:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268478464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.521395:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3310:x1874405268478464:12345-0@lo:400:kworker.0 Request processed in 49us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572481.521403:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787572481.521435:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268478976 00000100:00100000:3.0:1787572481.521439:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268478976 00000100:00100000:3.0:1787572481.521470:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268478592 00000100:00100000:3.0:1787572481.521473:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268478592 00000100:00100000:3.0:1787572481.521484:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268478720 00000100:00100000:3.0:1787572481.521487:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268478720 00000100:00100000:3.0:1787572481.521500:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787572481.521506:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268478976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.521542:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268478976:12345-0@lo:400:kworker.0 Request processed in 36us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572481.521548:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787572481.521560:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787572481.521566:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268478592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.521593:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268478592:12345-0@lo:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572481.521606:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787572481.521619:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787572481.521625:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268478720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.524664:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268478720:12345-0@lo:400:kworker.0 Request processed in 3030us (3473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572481.524678:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787572481.524728:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268479104 00000100:00100000:3.0:1787572481.524737:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268479104 00000100:00100000:3.0:1787572481.524779:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268478848 00000100:00100000:3.0:1787572481.524783:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268478848 00000100:00100000:3.0:1787572481.524806:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787572481.524814:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268479104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.524854:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268479104:12345-0@lo:400:kworker.0 Request processed in 41us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572481.524859:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787572481.524869:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787572481.524875:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268478848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.524955:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268478848:12345-0@lo:400:kworker.0 Request processed in 79us (3731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572481.524961:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1787572481.524990:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787572481.524994:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572481.524996:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572481.525037:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268478848:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.525137:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268478720:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.525191:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268478592:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.525201:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268479104:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.525212:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268478464:0@lo:400:kworker.0 00000100:00100000:3.0:1787572481.525223:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268478976:0@lo:400:kworker.0 00000020:01000004:2.0:1787572481.600450:0:12986:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787572481.619435:0:12986:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787572481.619488:0:12986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619504:0:12986:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619512:0:12986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619518:0:12986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619546:0:12986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787572481.619553:0:12986:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787572481.619579:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572481.619585:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619592:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30800 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:3.0:1787572481.619595:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619622:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787572481.619629:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572481.619652:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787572481.619655:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787572481.619657:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787572481.619694:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619701:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787572481.619721:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619729:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1d0a30800/0x9fe530ef4f436329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436330 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.619740:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572481.619742:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572481.619744:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572481.619760:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268479232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787572481.619827:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787572481.619898:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787572481.619902:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787572481.619907:0:12986:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787572481.619919:0:12986:0:(import.c:65:import_set_state_nolock()) ffff98d1c74b9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787572481.620199:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268479232 00000100:00100000:2.0:1787572481.620207:0:7642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268479232 00000100:00100000:2.0:1787572481.620313:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787572481.620323:0:7642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d2e66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+19:3312:x1874405268479232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572481.620335:0:7642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572481.620351:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206278200/0x9fe530ef4f436330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f436329 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.620364:0:7642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572481.620405:0:7642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d2e66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d30d720-8336-413c-aa2f-3c1df9a74652+18:3312:x1874405268479232:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572481.620413:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787572481.621509:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268479360:0@lo:39:umount.0 00000100:00100000:1.0:1787572481.621573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572481.621623:0:7555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268479360 00000100:00100000:1.0:1787572481.621630:0:7555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268479360 00000100:00100000:1.0:1787572481.621687:0:7555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787572481.621694:0:7555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874405268479360:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787572481.621721:0:7555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4360ac 00000100:00080000:1.0:1787572481.621728:0:7555:0:(import.c:65:import_set_state_nolock()) ffff98d1cebed000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787572481.621783:0:7555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1874405268479360:12345-0@lo:39:umount.0 Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572481.621790:0:7555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787572481.621799:0:7555:0:(genops.c:885:class_export_put()) final put ffff98d1c74bf000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787572481.621824:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787572481.621849:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1c74b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787572481.621862:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268479360:0@lo:39:umount.0 00000020:00000080:1.0:1787572481.621896:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1c74bf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787572481.621944:0:473:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1cebed000 for lustre-MDT0000 00000100:00100000:1.0:1787572481.625672:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268479232:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787572481.626095:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787572481.626109:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787572481.626115:0:12986:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787572481.627207:0:12986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.627222:0:12986:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.627242:0:12986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.627249:0:12986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.627277:0:12986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572481.627283:0:12986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.627897:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572481.627906:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.627914:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d206278600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:2.0:1787572481.627919:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.627928:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787572481.627936:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572481.627942:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787572481.627945:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787572481.627981:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.627989:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787572481.628014:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.628021:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d206278600/0x9fe530ef4f436337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43633e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.628038:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572481.628041:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572481.628042:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572481.628050:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572481.628067:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268479488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787572481.628147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572481.628201:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268479488 00000100:00100000:2.0:1787572481.628210:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268479488 00010000:00010000:3.0:1787572481.628886:0:12986:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628899:0:12986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628906:0:12986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628930:0:12986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572481.628938:0:12986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628958:0:12986:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628965:0:12986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628971:0:12986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628982:0:12986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787572481.628987:0:12986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628993:0:12986:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.628999:0:12986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.629005:0:12986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.629011:0:12986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787572481.629014:0:12986:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787572481.629018:0:12986:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787572481.629045:0:12986:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787572481.629049:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787572481.629053:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787572481.629059:0:12986:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787572481.629069:0:12986:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98d1fbeb9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787572481.629075:0:12986:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98d0c51a0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787572481.629079:0:12986:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff98d1d5ee19b8) has exports, disconnecting them 00000020:00080000:3.0:1787572481.629084:0:12986:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98d1fbeb9800), last request at 1787572481 00000020:00000080:3.0:1787572481.629090:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43621f 00000100:00080000:3.0:1787572481.629106:0:12986:0:(import.c:65:import_set_state_nolock()) ffff98d1fbda3800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787572481.629149:0:12986:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d1fbeb9800): rc 0 00000020:00000080:3.0:1787572481.629152:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1fbeb9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787572481.629162:0:12986:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98d0c51a0000), last request at 1787572481 00000020:00000080:3.0:1787572481.629165:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436154 00000100:00080000:3.0:1787572481.629170:0:12986:0:(import.c:65:import_set_state_nolock()) ffff98d0c51a5000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787572481.629176:0:12986:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d0c51a0000): rc 0 00000020:00000080:3.0:1787572481.629178:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d0c51a0000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787572481.629185:0:12986:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa6184381bae0 00000100:00080000:3.0:1787572481.629205:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787572481.629208:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787572481.629219:0:12986:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787572481.629288:0:12986:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787572481.629435:0:12986:0:(import.c:65:import_set_state_nolock()) ffff98d0c4b80000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787572481.629462:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787572481.629465:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787572481.629475:0:12986:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787572481.629616:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787572481.629629:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc703800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+18:3312:x1874405268479488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572481.629660:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572481.629676:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206278c00/0x9fe530ef4f43633e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f436337 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.629691:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572481.629744:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc703800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:3312:x1874405268479488:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572481.629752:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787572481.629814:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787572481.629821:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.629838:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462400 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572481.629842:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.629852:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572481.629871:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572481.629878:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787572481.629881:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787572481.629884:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787572481.629904:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.629911:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572481.629930:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.629938:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f436257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43625e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.629954:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787572481.629958:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.629964:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277200 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572481.629967:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.629980:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572481.629987:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572481.629993:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787572481.629995:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787572481.629997:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787572481.630011:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.630017:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572481.630023:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.630029:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f436559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436560 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.630038:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572481.630042:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.630048:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:0.0:1787572481.630051:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.630058:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572481.630074:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572481.630079:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787572481.630082:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787572481.630083:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787572481.630096:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.630103:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787572481.630113:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.630120:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f43600b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f436012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572481.630132:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572481.630134:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572481.630136:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572481.630155:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268479744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787572481.630193:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787572481.630260:0:12986:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787572481.630272:0:12986:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf18000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787572481.630316:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98d1d5ee19b8) has no exports 00000100:00100000:3.0:1787572481.631084:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268480000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787572481.631123:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572481.631370:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787572481.631378:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268479872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787572481.631405:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572481.631611:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268479744 00000100:00100000:1.0:1787572481.631620:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268479744 00000100:00100000:1.0:1787572481.631683:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787572481.631694:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30d720-8336-413c-aa2f-3c1df9a74652+17:3310:x1874405268479744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572481.631706:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572481.631721:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c0031400/0x9fe530ef4f43625e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f436257 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572481.631740:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572481.631770:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3310:x1874405268479744:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572481.631777:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1787572481.631800:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1fbeb9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787572481.631842:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c51a0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787572481.631865:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1fbda3800 for lustre-MDT0000 00000020:00000080:1.0:1787572481.631870:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c51a5000 for lustre-MDT0000 00000100:00100000:1.0:1787572481.631885:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268479616:0@lo:9:umount.0 00000100:00100000:1.0:1787572481.631930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572481.631952:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268480128:0@lo:9:umount.0 00000100:00100000:1.0:1787572481.631973:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572481.632009:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268479616 00000100:00100000:1.0:1787572481.632013:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268479616 00000100:00100000:1.0:1787572481.632038:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268480128 00000100:00100000:1.0:1787572481.632050:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268480128 00000100:00100000:1.0:1787572481.632074:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787572481.632081:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874405268479616:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787572481.632102:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4361a1 00000100:00080000:1.0:1787572481.632110:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d0c51a4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787572481.632144:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787572481.633045:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3309:x1874405268479616:12345-0@lo:9:umount.0 Request processed in 961us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572481.633056:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787572481.633075:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787572481.633085:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874405268480128:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787572481.633101:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436288 00000100:00080000:1.0:1787572481.633107:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98d0c52f4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787572481.633129:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787572481.633349:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3309:x1874405268480128:12345-0@lo:9:umount.0 Request processed in 266us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572481.633356:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787572481.633408:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d0c4b80000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787572481.633422:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787572481.633424:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787572481.633427:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268479616:0@lo:9:umount.0 00000100:00080000:1.0:1787572481.633439:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1cdf18000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787572481.633447:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787572481.633449:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787572481.633452:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268480128:0@lo:9:umount.0 00010000:00010000:1.0:1787572481.633484:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572481.633490:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572481.635338:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268479744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787572481.635373:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572481.635399:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268479488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787572481.635789:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268479872 00000100:00100000:2.0:1787572481.635796:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268479872 00000100:00100000:2.0:1787572481.635845:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268480000 00000100:00100000:2.0:1787572481.635849:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268480000 00000100:00100000:2.0:1787572481.635866:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787572481.635875:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+17:3310:x1874405268479872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572481.635887:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572481.635905:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0eb400/0x9fe530ef4f436560 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f436559 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.635918:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572481.635967:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+16:3310:x1874405268479872:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (4562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572481.635974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787572481.635988:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787572481.636002:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+15:3312:x1874405268480000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572481.636011:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572481.636020:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c9800/0x9fe530ef4f436012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f43600b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572481.636031:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572481.636060:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d30d720-8336-413c-aa2f-3c1df9a74652+14:3312:x1874405268480000:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572481.636066:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787572481.636094:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268480000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787572481.636118:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d30d720-8336-413c-aa2f-3c1df9a74652:3310:1874405268479872:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787572481.643875:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98d1d5ee19b8) has no exports 00000020:00000080:1.0:1787572481.720700:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436066 00000020:00000080:1.0:1787572481.720718:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1d5ef6000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787572481.720749:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787572481.720933:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d5ef6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787572481.721154:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787572481.721165:0:12986:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787572481.721170:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff98d1c4de19b8) has no exports 00000020:00000080:0.0:1787572481.721546:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43605f 00000020:00000080:0.0:1787572481.721554:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1d2e5d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787572481.721617:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787572481.721624:0:12986:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787572481.721627:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1d2e58800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787572481.721629:0:12986:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d2e58800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787572481.721667:0:12986:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787572481.721859:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d2e5d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787572481.722765:0:12986:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d1eadb3ea0 - data ffff98d1f2b4c510/ffff98d0c689c400 00000020:01000000:0.0:1787572481.722917:0:12986:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d1cde2a600 - data ffff98d1eb055e58/ffff98d1ee3c9800 00000001:00000004:0.0:1787572481.743830:0:12986:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1787572481.839809:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787572481.858096:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787572481.858105:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787572481.858132:0:12986:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787572481.858134:0:12986:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787572481.858556:0:7007:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787572481.858562:0:7007:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787572481.858582:0:7007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787572481.861834:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787572481.861844:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787572481.861863:0:12986:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787572481.861865:0:12986:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787572481.862796:0:8057:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787572481.862803:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787572481.862819:0:8057:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787572481.945704:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43602e 00000020:00000080:2.0:1787572481.945717:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1cebe8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787572481.945769:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cebe8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787572481.950555:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436043 00000020:00000080:2.0:1787572481.950630:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1ce6b8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787572481.951042:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787572481.951051:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787572481.951061:0:12986:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787572481.951078:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff98d1d5ee4d28) has no exports 00000020:00000080:3.0:1787572481.951269:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1ce6b8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787572481.951277:0:12986:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787572481.951287:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436281 00000020:00000080:2.0:1787572481.951293:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d0c52f7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787572481.951310:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c52f7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787572481.952728:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787572481.952742:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787572481.952756:0:12986:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787572481.952764:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff98d1d5ed3370) has no exports 00000020:00000080:2.0:1787572481.952774:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43627a 00000020:00000080:2.0:1787572481.952781:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1cdf1b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787572481.952973:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cdf1b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787572481.953575:0:12986:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787572481.953581:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787572481.953585:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787572481.953591:0:12986:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787572481.953593:0:12986:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787572481.953669:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572481.953678:0:12986:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787572481.953685:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43619a 00000020:00000080:2.0:1787572481.953691:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1fbda4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787572481.953696:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787572481.953700:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787572481.953704:0:12986:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1787572481.953706:0:473:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1cdf18000 for lustre-OST0001-osc-MDT0000 00000020:00080000:2.0:1787572481.953707:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff98d1d5ed19b8) has no exports 00000020:00000080:2.0:1787572481.953712:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436193 00000020:00000080:3.0:1787572481.953714:0:473:0:(genops.c:885:class_export_put()) final put ffff98d0c4b87000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787572481.953715:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d0c4b87800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787572481.953716:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c4b87000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787572481.953721:0:473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:2.0:1787572481.955268:0:12986:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787572481.955275:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787572481.955278:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787572481.955285:0:12986:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787572481.955288:0:12986:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787572481.962165:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1fbda4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787572481.962190:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c4b87800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787572481.963199:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572481.963217:0:12986:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787572481.963277:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572481.963281:0:12986:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787572481.963287:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1c74b8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787572481.963291:0:12986:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1c74b8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787572481.963298:0:12986:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787572481.963833:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43604a 00000020:00000080:2.0:1787572481.963842:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1ce6ba800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787572481.963848:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787572481.963852:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787572481.963858:0:12986:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787572481.963861:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff98d1d5ee0000) has no exports 00000020:00000080:2.0:1787572481.963885:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572481.963901:0:12986:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787572481.963905:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436051 00000020:00000080:2.0:1787572481.963909:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1ce6ba000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787572481.963917:0:12986:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d1c4a88000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787572481.963920:0:12986:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1c4a88000 3 00000020:01000004:2.0:1787572481.963923:0:12986:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98d1c4a88000 from lustre-MDT0000 00000020:00000080:2.0:1787572481.964081:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572481.964087:0:12986:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787572481.964090:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1cebeb800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787572481.964092:0:12986:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cebeb800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787572481.964104:0:12986:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787572481.964136:0:12986:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787572481.964140:0:12986:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787572481.964144:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787572481.964146:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787572481.964149:0:12986:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787572481.964155:0:12986:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff98d1de1d9800 9d30d720-8336-413c-aa2f-3c1df9a74652 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787572481.964160:0:12986:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff98d1de1cb370) has exports, disconnecting them 00000020:00080000:2.0:1787572481.964165:0:12986:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98d1de1d9800), last request at 1787572238 00000020:00000080:2.0:1787572481.964178:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f435fef 00000020:00010000:2.0:1787572481.964190:0:12986:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d1de1d9800: total 2 00000100:00080000:2.0:1787572481.964195:0:12986:0:(import.c:65:import_set_state_nolock()) ffff98d1de1d8800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787572481.964215:0:12986:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d1de1d9800): rc 0 00000020:00080000:2.0:1787572481.964230:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff98d1de1cb370) has no exports 00000100:00100000:2.0:1787572481.964280:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98d1eac91400:5837] 2 exiting: rc = 0 00000020:00000080:2.0:1787572481.964776:0:473:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c4b80000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787572481.964784:0:473:0:(genops.c:885:class_export_put()) final put ffff98d0c4b85800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787572481.964786:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c4b85800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787572481.964791:0:473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787572481.964873:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1ce6ba800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787572481.964877:0:473:0:(genops.c:885:class_export_put()) final put ffff98d1cebe9000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787572481.964879:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cebe9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787572481.964882:0:473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787572481.965347:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1ce6ba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1787572481.966007:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d1de1d9800: total 0 00010000:00010000:3.0:1787572481.966043:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d1de1d9800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787572481.966073:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c9e00/0x9fe530ef4f436107 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f436100 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.966092:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f436544 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f43653d expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.966101:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc277800/0x9fe530ef4f436552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f43654b expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.966113:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d206279a00/0x9fe530ef4f4362f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f4362ea expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.966122:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8a00/0x9fe530ef4f4362ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f4362f8 expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.966147:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c9600/0x9fe530ef4f43630d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f436306 expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.966156:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1d0a30400/0x9fe530ef4f43634c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f436345 expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.966164:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c13c8600/0x9fe530ef4f43631b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9fe530ef4f436314 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572481.966172:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d1de1d9800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787572481.966184:0:5831:0:(genops.c:885:class_export_put()) final put ffff98d1de1d9800/9d30d720-8336-413c-aa2f-3c1df9a74652 00010000:00010000:3.0:1787572481.966203:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572481.966205:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572481.966207:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572481.966253:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98d1eac90600:5836] 1 exiting: rc = 0 00000020:00000080:2.0:1787572481.966253:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1de1d9800/9d30d720-8336-413c-aa2f-3c1df9a74652 for MGS 00000020:00000080:2.0:1787572481.966280:0:473:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1de1d8800 for MGS 00000100:00100000:3.0:1787572481.966337:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98d1c4f54600:5835] 0 exiting: rc = 1 00000100:00100000:2.0:1787572481.966409:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966417:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966422:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966427:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966433:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966439:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966444:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966520:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966531:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966537:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966544:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966549:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966555:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966560:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966631:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966664:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966670:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966675:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966681:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966686:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966692:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966697:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966702:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966707:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966713:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966718:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966724:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966729:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966734:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966739:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966745:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966751:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966756:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966762:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966766:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966772:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966777:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966782:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966787:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966792:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966798:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966803:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966808:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966813:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966818:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966823:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966827:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966833:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966838:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966843:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966855:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966860:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966864:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966870:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966874:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966880:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966884:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966890:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966894:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966900:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966905:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966911:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966916:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572481.966921:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787572481.967537:0:12986:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787572481.967542:0:12986:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787572481.969269:0:12986:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d1ef36e480 - data ffff98d1cf708af8/ffff98d1f40cdc00 00000020:01000000:3.0:1787572481.969955:0:12986:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d1ee333de0 - data ffff98d1cf723a20/ffff98d1d5f77800 00000020:00000080:3.0:1787572481.972319:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f435fd3 00000020:00000080:3.0:1787572481.972330:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1d16be800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787572481.972345:0:12986:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d1c4a88000 from MGS, refs=2 00000020:01000004:3.0:1787572481.972349:0:12986:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1c4a88000 2 00000020:01000004:3.0:1787572481.972352:0:12986:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98d1c4a88000 from MGS 00000020:00000080:3.0:1787572481.972375:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787572481.972383:0:12986:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787572481.972385:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1d16ba000/MGS 00000020:00000080:3.0:1787572481.972388:0:12986:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d16ba000/MGS for MGS 00000020:01000000:3.0:1787572481.972395:0:12986:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787572481.972452:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787572481.972456:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787572481.972473:0:12986:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787572481.972480:0:12986:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98d1c74ba800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787572481.972486:0:12986:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff98d1f3c68000) has exports, disconnecting them 00000020:00080000:3.0:1787572481.972491:0:12986:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98d1c74ba800), last request at 1787572239 00000020:00000080:3.0:1787572481.972496:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43609e 00000020:00080000:3.0:1787572481.972510:0:12986:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d1c74ba800): rc 0 00000020:00000080:3.0:1787572481.972515:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1c74ba800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787572481.973007:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d16be800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787572481.973018:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1c74ba800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787572481.974690:0:12986:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787572481.974696:0:12986:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787572481.974700:0:12986:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787572481.974708:0:12986:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787572481.974887:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572481.974895:0:12986:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787572481.974902:0:12986:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1c4a88000 1 00000020:00000080:2.0:1787572481.974908:0:12986:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f435fc5 00000020:00000080:2.0:1787572481.974916:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1d16b8800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787572481.974921:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787572481.974926:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787572481.975004:0:12986:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787572481.975008:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98d1c4de4d28) has no exports 00000020:00000080:0.0:1787572481.975094:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1c74b9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787572481.975102:0:8:0:(genops.c:885:class_export_put()) final put ffff98d1cebef800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787572481.975104:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cebef800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787572481.975119:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787572481.975173:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d16b8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787572482.066760:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787572482.066776:0:12986:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787572482.066783:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1c4a8b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787572482.066788:0:12986:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1c4a8b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787572482.066797:0:12986:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787572482.066915:0:12986:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98d1c4a8d800 00000020:01000000:0.0:1787572482.067069:0:12986:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787572482.067085:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787572482.067090:0:12986:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787572482.067096:0:12986:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff98d1d5ee3370) has no exports 00000100:00100000:2.0:1787572482.069779:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98d1cdf29a00:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1787572482.071855:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98d1cdf29600:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787572482.072827:0:7555:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98d0c4a2de00:7555] 3 exiting: rc = 0 00000100:00100000:1.0:1787572482.072921:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98d1c538b000:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1787572482.075394:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075420:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075426:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075432:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075437:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075443:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075449:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075454:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075459:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075468:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075474:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075480:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075486:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075492:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075497:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075503:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075509:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075515:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075520:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075525:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075530:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075536:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075543:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075548:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075554:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075694:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075705:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075712:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075718:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075725:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075730:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075736:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075742:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075748:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075754:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075758:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075771:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075776:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075782:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075787:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075793:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075799:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075805:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075810:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075816:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075821:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075826:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075831:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075836:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075841:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075846:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075852:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075857:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075863:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075867:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075874:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075880:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075887:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075893:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075898:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075904:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075910:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.075916:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.076061:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.089415:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98d1c79e7a00:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1787572482.091817:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98d1c79e7600:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1787572482.092047:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092058:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092066:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092073:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092080:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092086:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092112:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092118:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092125:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092131:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092138:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092144:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092151:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092157:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092162:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092168:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092174:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092179:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092185:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092190:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092195:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092201:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092206:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092212:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092217:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092235:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092240:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092244:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092249:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092254:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092260:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092265:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092271:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092276:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092282:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092288:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092294:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.092299:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093326:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093331:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093336:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093351:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093356:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093361:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093366:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093372:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093378:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093384:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093389:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093394:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093399:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093404:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093409:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093414:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093418:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093423:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093428:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093433:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093438:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093444:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093458:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093464:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093469:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.093473:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.094344:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98d1c79e6400:5847] 0 exiting: rc = 1 00000100:00100000:0.0:1787572482.094597:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98d1c79e7200:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1787572482.094986:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.094995:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095001:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095006:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095014:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095027:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095034:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095040:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095045:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095052:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095060:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095078:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095084:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095091:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095097:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095103:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095109:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095131:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095139:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095145:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095151:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095156:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095162:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095167:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095172:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095179:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095186:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095202:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095211:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095246:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095254:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095262:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095269:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095275:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095281:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095287:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095293:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095308:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095315:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095321:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095327:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095349:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095356:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095363:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095371:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095377:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095391:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095398:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095404:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095412:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095418:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095423:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095430:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095466:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095474:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095482:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095489:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095496:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095504:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095510:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095517:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095525:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095531:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.095538:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.119243:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98d1c538a200:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1787572482.119854:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98d1c538a800:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1787572482.120030:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120037:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120043:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120048:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120053:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120058:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120063:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120068:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120073:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120079:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120084:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120089:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120095:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120100:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120106:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120111:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120116:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120122:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120128:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120133:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120138:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120143:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120149:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120153:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120158:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120164:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120168:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120173:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120195:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120200:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120205:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120210:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120215:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120233:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120239:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120244:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120249:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120254:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120260:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120264:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120269:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120274:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120279:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120285:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120290:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120294:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120299:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120388:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120394:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120399:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120404:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120409:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120415:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120419:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120424:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120429:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120434:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120439:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120445:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120518:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120523:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120528:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120532:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.120545:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572482.121285:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98d1c538be00:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1787572482.121520:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98d1c538b600:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1787572482.124719:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124730:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124736:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124742:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124747:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124752:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124758:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124764:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124770:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124776:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124782:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124787:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124793:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124798:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124804:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124810:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124815:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124821:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124826:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124832:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124837:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124842:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124848:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124854:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124859:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124865:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124870:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124875:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124881:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124887:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124892:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124898:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124903:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124909:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124946:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124952:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124957:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124963:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124970:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124976:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124982:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124988:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.124993:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125000:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125005:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125011:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125017:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125022:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125028:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125033:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125039:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125044:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125050:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125055:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125061:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125066:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125072:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125077:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125082:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125087:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125093:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125098:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125104:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.125109:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.128197:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98d1d0a91c00:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1787572482.129745:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98d1d0879600:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1787572482.129906:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.129914:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.129919:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131416:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131486:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131492:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131497:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131503:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131508:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131514:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131519:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131524:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131530:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131535:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131541:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131546:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131551:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131556:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131571:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131577:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131582:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131587:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131593:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131599:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131604:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131609:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131614:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131619:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131624:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131630:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131652:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131658:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131662:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131834:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131843:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131848:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131853:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131858:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131863:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131874:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131879:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131884:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131895:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131901:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131906:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131910:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131915:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131920:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131934:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131940:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131946:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131951:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131956:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131961:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131966:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131972:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131976:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131981:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131986:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131991:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.131996:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.132002:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.132007:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.132012:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572482.133088:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98d1d0a90000:5855] 0 exiting: rc = 1 00000100:00100000:0.0:1787572482.134142:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98d1c79e6a00:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1787572482.137009:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98d1d0a90600:5857] 2 exiting: rc = 0 00000100:00100000:0.0:1787572482.137175:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137183:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137214:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137234:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137239:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137244:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137249:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137254:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137276:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137281:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137287:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137292:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.137297:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138254:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138267:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138272:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138279:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138285:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138292:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138297:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138384:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138392:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138399:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138404:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138410:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138416:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138868:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138879:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138885:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138899:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138907:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138913:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.138919:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140535:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140657:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140743:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140752:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140758:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140764:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140770:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140776:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140782:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140787:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140813:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140819:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140825:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140830:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140835:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140841:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140847:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140882:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140889:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140895:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140900:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140906:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140912:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.140918:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.141780:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.141795:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.141800:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.141807:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.141814:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.141820:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787572482.141826:0:12986:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787572482.160532:0:12986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787572482.160551:0:12986:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787572482.161173:0:12986:0:(genops.c:885:class_export_put()) final put ffff98d1d527b800/MDS_uuid 00000020:00000080:0.0:1787572482.161182:0:12986:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d527b800/MDS_uuid for MDS 00000020:01000000:0.0:1787572482.161191:0:12986:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787572482.161356:0:12986:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787572482.863493:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572483.887125:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572484.914005:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787572485.202045:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787572485.202058:0:6719:0:(genops.c:885:class_export_put()) final put ffff98d0c51a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787572485.202096:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c51a0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787572485.202155:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c51a4800 for lustre-OST0000 00000020:01000004:0.0:1787572485.479943:0:13137:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787572485.499829:0:13137:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787572485.499911:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572485.499932:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572485.499966:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572485.499975:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572485.500003:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787572485.500010:0:13137:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787572485.500044:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787572485.500050:0:13137:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787572485.500059:0:13137:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787572485.500100:0:13137:0:(import.c:65:import_set_state_nolock()) ffff98d0c51a3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787572485.500196:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572485.500206:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572485.500215:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eba00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572485.500220:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572485.500230:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572485.500238:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572485.500245:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787572485.500248:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787572485.500252:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787572485.500287:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572485.500294:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572485.500328:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572485.500349:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1de0eba00/0x9fe530ef4f436306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9fe530ef4f43630d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572485.500364:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572485.500366:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572485.500368:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572485.500380:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572485.500408:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268480384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572485.500524:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572485.500754:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268480384 00000100:00100000:1.0:1787572485.500765:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268480384 00000100:00100000:1.0:1787572485.500827:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787572485.500837:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3312:x1874405268480384:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787572485.500845:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787572485 with bad export cookie 11521669026082414575 00000100:00100000:2.0:1787572485.502769:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874405268480256:0@lo:39:umount.0 00000400:00000100:2.0:1787572485.502845:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874405268480256 offset 0 length 224: 4 00000100:00100000:1.0:1787572485.513006:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3312:x1874405268480384:12345-0@lo:103:ldlm_bl.0 Request processed in 12160us (12474us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787572485.513024:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787572485.513093:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787572485.513100:0:3312:0:(import.c:65:import_set_state_nolock()) ffff98d1de007000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787572485.513105:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787572485.522369:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.155@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787572485.522377:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787572485.522389:0:3312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d1f4529f80 x1874405268480384/t0(0) o103->MGC192.168.204.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787572501 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787572485.522461:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787572485.522465:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787572485.522491:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787572485.522496:0:3312:0:(import.c:65:import_set_state_nolock()) ffff98d1de007000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787572485.522502:0:3312:0:(import.c:510:import_select_connection()) MGC192.168.204.155@tcp: connect to NID 0@lo last attempt 168 00000100:00080000:1.0:1787572485.522514:0:3312:0:(import.c:624:import_select_connection()) MGC192.168.204.155@tcp: import ffff98d1de007000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1787572485.522556:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1f452b100 x1874405268480512/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787572485.522612:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d30d720-8336-413c-aa2f-3c1df9a74652:3312:1874405268480384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787572485.522745:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30d720-8336-413c-aa2f-3c1df9a74652:3309:1874405268480512:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787572485.522815:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874405268480512 offset 0 length 520: 4 00010000:00010000:1.0:1787572485.935410:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787572486.199963:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787572486.199976:0:7653:0:(genops.c:885:class_export_put()) final put ffff98d0c52f3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787572486.200060:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c52f3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787572486.200131:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c52f4800 for lustre-OST0001 00000100:00080000:3.0:1787572486.639809:0:473:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787572486.639823:0:473:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787572486.639963:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268480640:0@lo:400:kworker.0 00000400:00000100:2.0:1787572486.640043:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874405268480640 offset 0 length 224: 4 00010000:00010000:1.0:1787572486.959018:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572487.983322:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572489.007910:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572490.033630:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787572490.674543:0:473:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787572490.674558:0:473:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787572490.674879:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572490.674909:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268480768:0@lo:400:kworker.0 00000400:00000100:3.0:1787572490.675005:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874405268480768 offset 0 length 224: 4 00010000:00010000:1.0:1787572491.064815:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572492.078876:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572493.106285:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572494.127219:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572495.150900:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572495.854890:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787572485/real 1787572485] req@ffff98d1f452b100 x1874405268480512/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787572495 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572495.854924:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d1f452b100 x1874405268480512/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787572495 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572495.854937:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787572485/real 1787572485] req@ffff98d0c6ccc380 x1874405268480256/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787572495 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572495.854950:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d0c6ccc380 x1874405268480256/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787572495 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787572495.854979:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1de007000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787572495.854988:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787572495.854992:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30d720-8336-413c-aa2f-3c1df9a74652:3309:1874405268480512:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1787572495.854998:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d0c51a3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787572495.855017:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874405268480256:0@lo:39:umount.0 00000100:00080000:0.0:1787572495.855336:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787572495.855340:0:13137:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787572495.855346:0:13137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787572495.856288:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787572495.856295:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787572495.856299:0:37:0:(import.c:65:import_set_state_nolock()) ffff98d1de007000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787572495.856305:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.155@tcp: connect to NID 0@lo last attempt 415 00000100:00080000:3.0:1787572495.856311:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.155@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787572495.856319:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.155@tcp: import ffff98d1de007000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:3.0:1787572495.856372:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c6248700 x1874405268480896/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787572495.856474:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572495.856488:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268481024:0@lo:400:kworker.0 00000400:00000100:3.0:1787572495.856541:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874405268481024 offset 0 length 224: 4 00000100:00100000:2.0:1787572495.857989:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30d720-8336-413c-aa2f-3c1df9a74652:3309:1874405268480896:0@lo:250:kworker.0 00000400:00000100:2.0:1787572495.858041:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874405268480896 offset 0 length 520: 4 00010000:00010000:0.0:1787572495.859555:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572495.859574:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572495.859581:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572495.859587:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572495.860560:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572495.860570:0:13137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572495.860578:0:13137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572495.860584:0:13137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572495.860589:0:13137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572495.866902:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787572495.866920:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572495.866932:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31a00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572495.866937:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572495.866947:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572495.866964:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572495.866991:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787572495.866994:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1787572495.867009:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d1de007000 00010000:00010000:1.0:1787572495.867012:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572495.867018:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31a00/0x9fe530ef4f436314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f43631b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572495.867036:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572495.867041:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572495.867046:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276e00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572495.867049:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572495.867056:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572495.867062:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572495.867067:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787572495.867069:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787572495.867072:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d1de007000 00010000:00010000:1.0:1787572495.867074:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572495.867092:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572495.867094:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572495.867096:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572495.867180:0:13137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787572495.867189:0:13137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1fc276e00/0x9fe530ef4f43654b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f436552 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572495.867201:0:13137:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787572495.867208:0:13137:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1787572495.867210:0:13137:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787572495.867243:0:13137:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787572495.867247:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787572495.867254:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787572495.867260:0:13137:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787572495.867265:0:13137:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98d1f3c6cd28) has no exports 00000020:00080000:0.0:1787572495.867293:0:13137:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98d1f3c6cd28) has no exports 00000020:01000000:0.0:1787572495.868968:0:13137:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d1d0b347e0 - data ffff98d1eb38d438/ffff98d0c696bc00 00000020:01000000:0.0:1787572495.869121:0:13137:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d1d0a746c0 - data ffff98d1eb05e438/ffff98d1ef382800 00010000:00010000:1.0:1787572495.870120:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787572495.879969:0:13137:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787572495.921369:0:13137:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436123 00000020:00000080:1.0:1787572495.921380:0:13137:0:(genops.c:885:class_export_put()) final put ffff98d1f42c0800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787572495.921447:0:13137:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d1cebea800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787572495.921451:0:13137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1cebea800 2 00000020:01000004:1.0:1787572495.921455:0:13137:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98d1cebea800 from lustre-OST0000 00000020:00000080:1.0:1787572495.921482:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787572495.921494:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787572495.921498:0:13137:0:(genops.c:885:class_export_put()) final put ffff98d1f42c4000/lustre-OST0000_UUID 00000020:00000080:1.0:1787572495.921502:0:13137:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1f42c4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787572495.921510:0:13137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787572495.921557:0:13137:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787572495.921561:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787572495.921565:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787572495.921570:0:13137:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787572495.921577:0:13137:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98d0c50f5000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787572495.921583:0:13137:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff98d1c4de0000) has exports, disconnecting them 00000020:00080000:1.0:1787572495.921588:0:13137:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98d0c50f5000), last request at 1787572256 00000020:00000080:1.0:1787572495.921592:0:13137:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f43614d 00000020:00080000:1.0:1787572495.921612:0:13137:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d0c50f5000): rc 0 00000020:00000080:1.0:1787572495.921618:0:13137:0:(genops.c:885:class_export_put()) final put ffff98d0c50f5000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787572495.929580:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1f42c0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787572495.929598:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c50f5000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787572495.930742:0:13137:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787572495.930747:0:13137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787572495.930751:0:13137:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787572495.930758:0:13137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787572495.930931:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572495.930940:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787572495.930948:0:13137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1cebea800 1 00000020:00000080:2.0:1787572495.930964:0:13137:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4360dd 00000020:00000080:2.0:1787572495.930973:0:13137:0:(genops.c:885:class_export_put()) final put ffff98d1fbebc000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787572495.930979:0:13137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787572495.930995:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787572495.930998:0:13137:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787572495.931002:0:13137:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff98d1f3c6b370) has no exports 00000020:00000080:3.0:1787572495.931249:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c51a3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787572495.931257:0:37:0:(genops.c:885:class_export_put()) final put ffff98d1fbda1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787572495.931260:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1fbda1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787572495.931266:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787572495.931321:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1fbebc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787572495.974289:0:13137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572495.974310:0:13137:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787572495.974317:0:13137:0:(genops.c:885:class_export_put()) final put ffff98d1fbc2b000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787572495.974322:0:13137:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1fbc2b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787572495.974347:0:13137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787572495.974627:0:13137:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98d1eaccc000 00000020:02000400:2.0:1787572495.974720:0:13137:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787572496.177873:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572497.202398:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572498.224295:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787572498.908040:0:13290:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787572498.917879:0:13290:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787572498.917981:0:13290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572498.917996:0:13290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572498.918004:0:13290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572498.918012:0:13290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572498.918034:0:13290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787572498.918041:0:13290:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787572498.918124:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787572498.918136:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d0c6248000 x1874405268480640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572502 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572498.918155:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d1fc700a80 x1874405268480768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572506 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572498.918164:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d0c6249500 x1874405268481024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572498.918180:0:13290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787572498.918187:0:13290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787572498.918214:0:13290:0:(import.c:65:import_set_state_nolock()) ffff98d0c6517800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787572498.918272:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572498.918280:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572498.918293:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c8000 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572498.918297:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572498.918302:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874405268481024:0@lo:400:kworker.0 00010000:00010000:1.0:1787572498.918305:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572498.918312:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572498.918317:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787572498.918320:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787572498.918322:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787572498.918340:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d1de007000 00010000:00010000:1.0:1787572498.918350:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572498.918356:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c13c8000/0x9fe530ef4f4362ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f4362f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572498.918367:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572498.918369:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572498.918370:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572498.918442:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268480768:0@lo:400:kworker.0 00000100:00100000:2.0:1787572498.918463:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268480640:0@lo:400:kworker.0 00000100:00100000:2.0:1787572498.918489:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874405268481152:0@lo:39:umount.0 00000400:00000100:2.0:1787572498.918535:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874405268481152 offset 0 length 224: 4 00010000:00010000:1.0:1787572499.247930:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572500.271800:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787572500.976975:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787572500.976986:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787572501.294816:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572502.318902:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572503.343157:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572504.368515:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572505.390986:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787572506.098041:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787572506.098052:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787572506.417119:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572507.440788:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572508.143053:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787572498/real 1787572498] req@ffff98d0c624ad80 x1874405268481152/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787572508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572508.143090:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d0c624ad80 x1874405268481152/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787572508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787572508.143109:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d0c6517800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787572508.143125:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874405268481152:0@lo:39:umount.0 00000100:00080000:3.0:1787572508.143296:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787572508.143301:0:13290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787572508.143307:0:13290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787572508.144486:0:13290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572508.144504:0:13290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572508.144511:0:13290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572508.144518:0:13290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572508.144545:0:13290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572508.144567:0:13290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572508.144575:0:13290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572508.144581:0:13290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572508.144586:0:13290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572508.144610:0:13290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787572508.144616:0:13290:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787572508.144669:0:13290:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787572508.144674:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787572508.144679:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787572508.144685:0:13290:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787572508.144689:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98d1c4de3370) has no exports 00000020:00080000:3.0:1787572508.144728:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98d1c4de3370) has no exports 00010000:00010000:1.0:1787572508.145075:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787572508.145084:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572508.145092:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31c00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572508.145096:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572508.145106:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572508.145113:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572508.145119:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787572508.145121:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787572508.145123:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787572508.145138:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d1de007000 00010000:00010000:1.0:1787572508.145142:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572508.145150:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f4362f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f4362ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572508.145164:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572508.145177:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572508.145196:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671c00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572508.145199:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572508.145206:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572508.145213:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572508.145218:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787572508.145220:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787572508.145222:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787572508.145229:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d1de007000 00010000:00010000:1.0:1787572508.145232:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572508.145238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1f4671c00/0x9fe530ef4f43653d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f436544 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572508.145252:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572508.145254:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572508.145255:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572508.145413:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787572508.152971:0:13290:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d1d0b34ba0 - data ffff98d1eb38dbd0/ffff98d0c695c800 00000020:01000000:3.0:1787572508.153381:0:13290:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d1ef36e120 - data ffff98d1cf79a438/ffff98d0c6358800 00100000:10000000:3.0:1787572508.164456:0:13290:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787572508.204425:0:13290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4361ee 00000020:00000080:0.0:1787572508.204436:0:13290:0:(genops.c:885:class_export_put()) final put ffff98d0c6510000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787572508.204461:0:13290:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d1d0ba8000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787572508.204465:0:13290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1d0ba8000 2 00000020:01000004:0.0:1787572508.204468:0:13290:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98d1d0ba8000 from lustre-OST0001 00000020:00000080:0.0:1787572508.204494:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787572508.204504:0:13290:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787572508.204507:0:13290:0:(genops.c:885:class_export_put()) final put ffff98d1cde8c000/lustre-OST0001_UUID 00000020:00000080:0.0:1787572508.204509:0:13290:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cde8c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787572508.204519:0:13290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787572508.204728:0:13290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9d30d720-8336-413c-aa2f-3c1df9a74652->MGS 00010000:00010000:0.0:1787572508.204742:0:13290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f436107 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787572508.204754:0:13290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f436107 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572508.204759:0:13290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787572508.204762:0:13290:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787572508.204765:0:13290:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787572508.204778:0:13290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d1de007000 00010000:00010000:0.0:1787572508.204782:0:13290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f436100 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f436107 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572508.204797:0:13290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9fe530ef4f43634c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787572508.208549:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c6510000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:00010000:0.0:1787572508.208687:0:13290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9fe530ef4f43634c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572508.208694:0:13290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787572508.208697:0:13290:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787572508.208705:0:13290:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787572508.209156:0:13290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d1de007000 00010000:00010000:0.0:1787572508.209162:0:13290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d206279800/0x9fe530ef4f436345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9fe530ef4f43634c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787572508.209262:0:13290:0:(import.c:65:import_set_state_nolock()) ffff98d1de007000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787572508.209266:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787572508.209269:0:13290:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787572508.209271:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787572508.209276:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787572508.209287:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d0c6248700 x1874405268480896/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787572510 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787572508.209306:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787572508.209309:0:13290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1787572508.209386:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d30d720-8336-413c-aa2f-3c1df9a74652:3309:1874405268480896:0@lo:250:kworker.0 10000000:01000000:0.0:1787572508.209501:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787572508.209509:0:13290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f435fe1 00000020:00000080:0.0:1787572508.209517:0:13290:0:(genops.c:885:class_export_put()) final put ffff98d1c5ee6800/9d30d720-8336-413c-aa2f-3c1df9a74652 00000020:01000000:0.0:1787572508.209534:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.155@tcp (flags='') 00000020:00000080:0.0:1787572508.209540:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787572508.209552:0:13290:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.155@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787572508.209556:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff98d1d5ed4d28) has no exports 10000000:01000000:2.0:1787572508.209659:0:5839:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1787572508.209805:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1c5ee6800/9d30d720-8336-413c-aa2f-3c1df9a74652 for MGC192.168.204.155@tcp 10000000:01000000:0.0:1787572508.209863:0:13290:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.155@tcp: client import never connected 00000100:00080000:0.0:1787572508.209870:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787572508.209873:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787572508.209875:0:13290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787572508.209891:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787572508.209936:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787572508.209943:0:13290:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.155@tcp (uuid 9d30d720-8336-413c-aa2f-3c1df9a74652) 00000020:01000000:0.0:1787572508.209949:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787572508.209952:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787572508.209956:0:13290:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787572508.209961:0:13290:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98d1fbebf000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787572508.209967:0:13290:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff98d0c5804d28) has exports, disconnecting them 00000020:00080000:0.0:1787572508.209971:0:13290:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98d1fbebf000), last request at 1787572274 00000020:00000080:0.0:1787572508.209975:0:13290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f436218 00000020:00080000:0.0:1787572508.209987:0:13290:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d1fbebf000): rc 0 00000020:00000080:0.0:1787572508.209991:0:13290:0:(genops.c:885:class_export_put()) final put ffff98d1fbebf000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787572508.211362:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d1de007000 for MGC192.168.204.155@tcp 00000020:00000080:1.0:1787572508.211374:0:37:0:(genops.c:885:class_export_put()) final put ffff98d1de005800/9d30d720-8336-413c-aa2f-3c1df9a74652 00000020:00000080:1.0:1787572508.211377:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1de005800/9d30d720-8336-413c-aa2f-3c1df9a74652 for MGC192.168.204.155@tcp 00000020:01000000:1.0:1787572508.211396:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.155@tcp (9d30d720-8336-413c-aa2f-3c1df9a74652) 00000020:00000080:1.0:1787572508.211668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1fbebf000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787572508.213992:0:13290:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787572508.214000:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787572508.214004:0:13290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787572508.214010:0:13290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787572508.214106:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d0c6517800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787572508.214308:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787572508.216293:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1787572508.220184:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98d1eadc0e00:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1787572508.220275:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98d1c5a63400:5825] 0 exiting: rc = 1 00000100:00100000:2.0:1787572508.220403:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.220699:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98d1eadc1a00:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1787572508.220769:0:7642:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98d0c6ff1600:7642] 3 exiting: rc = 0 00000100:00100000:1.0:1787572508.225921:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98d1d09e6000:5829] 2 exiting: rc = 0 00000100:00100000:1.0:1787572508.227009:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98d1eadc0200:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1787572508.227305:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227314:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227320:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227326:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227331:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227337:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227343:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227349:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227354:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227359:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227540:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227550:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227557:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227562:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227568:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227574:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227580:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227585:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227590:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227596:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227601:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227607:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227612:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227616:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227622:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227628:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227737:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227745:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227750:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227755:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227761:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227766:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227771:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227776:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227782:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.227801:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228232:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228237:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228242:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228247:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228252:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228257:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228263:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228268:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228273:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228278:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228283:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228289:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228295:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228301:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228307:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228313:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228318:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228323:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228329:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228355:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228362:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228377:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228382:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228387:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228393:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228397:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228402:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.228407:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787572508.229510:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787572508.229520:0:13290:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787572508.229526:0:13290:0:(genops.c:885:class_export_put()) final put ffff98d0c6516800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787572508.229531:0:13290:0:(genops.c:844:class_export_destroy()) destroying export ffff98d0c6516800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787572508.229537:0:13290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787572508.229590:0:13290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1d0ba8000 1 00000020:00000080:2.0:1787572508.229597:0:13290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9fe530ef4f4361bd 00000020:00000080:2.0:1787572508.229603:0:13290:0:(genops.c:885:class_export_put()) final put ffff98d1cde89000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787572508.229622:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787572508.229628:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787572508.229653:0:13290:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787572508.229657:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff98d1d5ed0000) has no exports 00000020:00000080:1.0:1787572508.229739:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1cde89000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787572508.251287:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787572508.251303:0:13290:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787572508.251309:0:13290:0:(genops.c:885:class_export_put()) final put ffff98d1d0baa000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787572508.251314:0:13290:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1d0baa000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787572508.251325:0:13290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787572508.251559:0:13290:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98d1d0bab800 00000020:01000000:1.0:1787572508.251586:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787572508.251591:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787572508.251595:0:13290:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787572508.251599:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff98d1de1ccd28) has no exports 00000020:00000080:1.0:1787572508.251626:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787572508.251653:0:13290:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787572508.251656:0:13290:0:(genops.c:885:class_export_put()) final put ffff98d1fbebe800/OSS_uuid 00000020:00000080:1.0:1787572508.251659:0:13290:0:(genops.c:844:class_export_destroy()) destroying export ffff98d1fbebe800/OSS_uuid for OSS 00000020:01000000:1.0:1787572508.251663:0:13290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1787572508.251691:0:5838:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787572508.251879:0:12010:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98d1c3ac9000:12010] 3 exiting: rc = 0 00000100:00100000:1.0:1787572508.251935:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98d1c2d96a00:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1787572508.251986:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98d1d0a34600:6693] 2 exiting: rc = 0 00000100:00100000:1.0:1787572508.252046:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98d1d0a34000:6690] 0 exiting: rc = 1 00000100:00100000:1.0:1787572508.252105:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252121:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252129:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252137:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252142:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252148:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252154:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252159:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252178:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252184:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252189:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252194:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252199:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252205:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252211:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252216:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252222:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252229:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252234:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252239:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252245:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252251:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252257:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252263:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252269:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252276:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252281:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252288:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252293:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252299:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252319:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252325:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252332:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252338:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252343:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252349:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252355:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252360:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252366:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252371:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252376:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252381:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252385:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252390:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252395:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252401:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252406:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252411:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252416:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252421:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252426:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252431:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252437:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252442:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252448:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252456:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252461:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252466:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252472:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252477:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252481:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252487:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252492:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.252505:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787572508.253983:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98d1d09e4e00:6695] 1 exiting: rc = 0 00000100:00100000:2.0:1787572508.256770:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98d1d09e4a00:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1787572508.257059:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257082:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257087:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257093:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257097:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257102:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257107:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257113:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257118:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257124:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257129:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257134:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257139:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257145:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257151:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257157:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257172:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257178:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257184:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257190:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257196:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257201:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257206:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257212:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257217:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257223:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257228:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257234:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257239:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257245:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257250:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257255:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257261:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257267:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257272:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257277:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257289:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257295:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257300:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257306:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257310:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257315:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257319:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257324:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257329:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257333:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257338:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257342:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257347:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257352:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257356:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257362:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257367:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257372:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257376:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257381:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257386:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257391:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257396:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257402:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257407:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257411:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257416:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.257421:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.258339:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98d1d09e4200:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1787572508.259011:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98d1c2d97a00:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1787572508.259613:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98d1d09e5400:6698] 2 exiting: rc = 0 00000100:00100000:1.0:1787572508.259985:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.259994:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260001:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260007:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260013:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260030:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260036:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260042:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260047:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260052:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260058:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260073:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260079:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260087:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260095:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260101:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260110:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260119:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260131:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260141:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260148:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260155:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260287:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260297:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260302:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260307:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260313:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260318:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260324:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260329:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260334:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260339:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260344:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260350:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260355:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260373:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260380:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260387:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260392:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260397:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260411:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260416:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260421:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260425:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260431:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260436:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260442:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260448:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260456:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260461:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260468:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260483:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260490:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260495:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260501:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260507:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260512:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260529:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260535:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260540:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260544:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260549:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260555:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.260560:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.267560:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98d1d519f600:6699] 0 exiting: rc = 1 00000100:00100000:1.0:1787572508.267734:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98d1c2f79000:6700] 1 exiting: rc = 0 00000100:00100000:1.0:1787572508.267794:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267800:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267916:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267921:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267926:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267931:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267937:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267941:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267946:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267951:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267969:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267974:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267979:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267983:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267988:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.267994:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268001:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268008:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268017:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268022:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268031:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268037:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268077:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268083:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268089:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268094:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268099:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268104:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268108:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268113:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268117:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268122:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268143:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268150:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268155:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268222:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268231:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268236:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268241:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268245:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268249:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268253:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268259:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268264:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268268:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268281:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268286:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268290:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268302:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268308:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268313:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268317:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268322:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268327:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268331:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268336:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268341:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268346:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268351:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268355:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268361:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268366:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268371:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.268376:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787572508.272366:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98d1f43bf200:6701] 0 exiting: rc = 1 00000100:00100000:1.0:1787572508.274614:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98d1c5308200:6702] 1 exiting: rc = 0 00000100:00100000:1.0:1787572508.275111:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.275118:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.275129:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.275136:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.275143:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.275152:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.275157:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.278099:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.278122:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.278128:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.278133:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.278141:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.278146:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.278152:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.278158:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279017:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279025:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279030:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279043:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279049:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279055:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279065:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279072:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279077:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279082:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279087:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279093:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279112:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279121:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279127:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279133:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279139:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279144:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279152:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279159:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279951:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279960:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279966:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.279973:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280268:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280280:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280287:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280297:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280305:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280317:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280332:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280341:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280347:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280355:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280403:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280423:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280451:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280459:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280473:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280479:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280488:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280495:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280504:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280511:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280516:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280523:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280528:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280534:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787572508.280542:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787572508.296194:0:13290:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787572525.598512:0:13905:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787572535.045598:0:14366:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787572535.045605:0:14366:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787572535.046011:0:14366:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d1f4534000 00000020:01000004:0.0:1787572535.046029:0:14366:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787572535.046037:0:14366:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787572535.046051:0:14366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98d1f3c68000) 00000020:00000080:0.0:1787572535.046066:0:14366:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787572535.063791:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787572535.071164:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1787572535.071517:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 453: rc = 0 00100000:10000000:0.0:1787572535.071617:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 453: rc = 0 00100000:10000000:0.0:1787572535.071746:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 453: rc = 0 00100000:10000000:0.0:1787572535.071838:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 453: rc = 0 00100000:10000000:0.0:1787572535.071931:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 453: rc = 0 00100000:10000000:0.0:1787572535.072129:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787572535.072215:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 453: rc = 0 00100000:10000000:0.0:1787572535.072466:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 455: rc = 0 00100000:10000000:2.0:1787572535.076971:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 358: rc = 0 00100000:10000000:2.0:1787572535.077080:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 358: rc = 0 00100000:10000000:2.0:1787572535.078135:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1787572535.082788:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 521: rc = 0 00100000:10000000:3.0:1787572535.083435:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1787572535.083806:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 521: rc = 0 00100000:10000000:3.0:1787572535.084742:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 521: rc = 0 00100000:10000000:3.0:1787572535.085017:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1787572535.085280:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1787572535.085532:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 521: rc = 0 00100000:10000000:3.0:1787572535.085822:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 521: rc = 0 00100000:10000000:3.0:1787572535.086075:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 521: rc = 0 00100000:10000000:3.0:1787572535.087745:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1787572535.088375:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1787572535.089463:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 722: rc = 0 00100000:10000000:3.0:1787572535.090269:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 722: rc = 0 00100000:10000000:3.0:1787572535.090575:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 722: rc = 0 00100000:10000000:3.0:1787572535.091751:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 722: rc = 0 00100000:10000000:3.0:1787572535.092034:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 722: rc = 0 00100000:10000000:3.0:1787572535.092265:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 722: rc = 0 00100000:10000000:3.0:1787572535.099921:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 722: rc = 0 00100000:10000000:3.0:1787572535.100210:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 722: rc = 0 00100000:10000000:3.0:1787572535.104007:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 722: rc = 0 00100000:10000000:3.0:1787572535.106990:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 722: rc = 0 00100000:10000000:3.0:1787572535.109747:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 722: rc = 0 00100000:10000000:3.0:1787572535.110946:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 722: rc = 0 00100000:10000000:3.0:1787572535.111256:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 722: rc = 0 00100000:10000000:3.0:1787572535.111523:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 722: rc = 0 00100000:10000000:2.0:1787572535.112340:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 722: rc = 0 00100000:10000000:2.0:1787572535.112607:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 722: rc = 0 00100000:10000000:2.0:1787572535.112923:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 722: rc = 0 00100000:10000000:2.0:1787572535.113170:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 722: rc = 0 00100000:10000000:2.0:1787572535.113451:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 722: rc = 0 00100000:10000000:2.0:1787572535.113755:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 722: rc = 0 00100000:10000000:2.0:1787572535.114007:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 722: rc = 0 00100000:10000000:2.0:1787572535.114268:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 722: rc = 0 00100000:10000000:2.0:1787572535.114527:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 722: rc = 0 00100000:10000000:2.0:1787572535.114823:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 722: rc = 0 00100000:10000000:2.0:1787572535.115574:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 722: rc = 0 00100000:10000000:2.0:1787572535.119179:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 722: rc = 0 00100000:10000000:2.0:1787572535.120101:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 722: rc = 0 00100000:10000000:2.0:1787572535.121183:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 722: rc = 0 00100000:10000000:2.0:1787572535.122547:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 722: rc = 0 00100000:10000000:2.0:1787572535.123997:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 722: rc = 0 00100000:10000000:2.0:1787572535.125035:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 722: rc = 0 00100000:10000000:2.0:1787572535.126626:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 722: rc = 0 00100000:10000000:2.0:1787572535.128589:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 535: rc = 0 00100000:10000000:2.0:1787572535.132471:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787572535.132757:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 359: rc = 0 00100000:10000000:2.0:1787572535.133016:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787572535.133092:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 359: rc = 0 00100000:10000000:2.0:1787572535.133305:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787572535.133803:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 359: rc = 0 00100000:10000000:2.0:1787572535.134161:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787572535.134242:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 362: rc = 0 00100000:10000000:2.0:1787572535.134613:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787572535.136020:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 362: rc = 0 00100000:10000000:2.0:1787572535.136262:0:14366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787572535.136964:0:14366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 362: rc = 0 00000020:00000080:2.0:1787572535.137267:0:14366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787572535.137275:0:14366:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787572535.137298:0:14366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f4372e9 00000020:01000004:2.0:1787572535.137306:0:14366:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787572535.137311:0:14366:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787572535.137317:0:14366:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d1f4534000 from MGS 00000020:01000004:2.0:1787572535.137320:0:14366:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787572535.137332:0:14366:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98d1de1ccd28) 00000020:00000080:2.0:1787572535.137341:0:14366:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787572535.137399:0:14366:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d1f4534000 from MGS, refs=2 00080000:01000000:2.0:1787572535.137404:0:14366:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787572535.137409:0:14366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f4372f7 00000100:00100000:2.0:1787572535.137514:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787572535.137688:0:14366:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787572535.137694:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787572535.141180:0:14366:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787572535.141307:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787572535.143387:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787572535.143608:0:14366:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787572535.143615:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787572535.144385:0:14366:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787572535.144394:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787572535.145029:0:14366:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787572535.145036:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787572535.145885:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572535.145889:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572535.145891:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572535.146159:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572535.146162:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572535.146164:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572535.146816:0:14366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787572535.152541:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787572535.172244:0:14366:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787572535.172264:0:14366:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787572535.172267:0:14366:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787572535.178178:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787572535.179369:0:14366:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787572535.179491:0:14366:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787572535.180548:0:14366:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787572535.183456:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787572535.184254:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787572535.185140:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787572535.189828:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787572535.189855:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787572535.191324:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787572535.191335:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787572535.192366:0:14366:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787572535.192391:0:14366:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.155@tcp' 00000020:01000004:1.0:1787572535.192392:0:14366:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787572535.192435:0:14366:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.155@tcp (typ=mgc) 00000020:00000080:1.0:1787572535.192450:0:14366:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.155@tcp (ffff98d1d5ed0000) 00000020:00000080:1.0:1787572535.192468:0:14366:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787572535.192540:0:14366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d1c6028000@MGC192.168.204.155@tcp: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1787572535.192787:0:14366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.155@tcp-0 is initialized 00000040:01000000:1.0:1787572535.192794:0:14366:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787572535.193030:0:14380:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787572535.201475:0:14381:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787572535.201810:0:14366:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.155@tcp (uuid 39be3db9-5eba-42e2-9087-a4df3ec904cb) 00000020:00000080:3.0:1787572535.201834:0:14366:0:(genops.c:1385:class_connect()) connect: client 39be3db9-5eba-42e2-9087-a4df3ec904cb, cookie 0x9fe530ef4f437305 00000100:00080000:3.0:1787572535.201960:0:14366:0:(import.c:510:import_select_connection()) MGC192.168.204.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787572535.202092:0:14366:0:(import.c:624:import_select_connection()) MGC192.168.204.155@tcp: import ffff98d1c6028000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:3.0:1787572535.202129:0:14366:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c6248380 x1874405268481280/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787572535.202156:0:14366:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 39be3db9-5eba-42e2-9087-a4df3ec904cb->MGS 00000020:01000004:3.0:1787572535.202184:0:14366:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787572535.202189:0:14366:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787572535.202214:0:14366:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98d0c58019b8) 00000020:00000080:3.0:1787572535.202225:0:14366:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787572535.205356:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39be3db9-5eba-42e2-9087-a4df3ec904cb:3309:1874405268481280:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787572535.205436:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572535.205735:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268481280 00000100:00100000:2.0:1787572535.205745:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268481280 00000100:00100000:2.0:1787572535.205786:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572535.205795:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874405268481280:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787572535.205825:0:14376:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 39be3db9-5eba-42e2-9087-a4df3ec904cb@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1787572535.205877:0:14376:0:(genops.c:1385:class_connect()) connect: client 39be3db9-5eba-42e2-9087-a4df3ec904cb, cookie 0x9fe530ef4f437313 00000100:00080000:2.0:1787572535.206023:0:14376:0:(import.c:65:import_set_state_nolock()) ffff98d1d5cf6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572535.206082:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+5:3309:x1874405268481280:12345-0@lo:250:mount.lustre.0 Request processed in 287us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.206089:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787572535.206363:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787572535.206372:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.155@tcp: connect to target with instance 0 00000100:00080000:0.0:1787572535.206380:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787572535.206385:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787572535.206389:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1c6028000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787572535.206391:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787572535.206399:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787572535.206404:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39be3db9-5eba-42e2-9087-a4df3ec904cb:3309:1874405268481280:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787572535.228494:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787572535.228764:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787572535.228771:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787572535.237241:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787572535.237257:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787572535.238102:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787572535.238112:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787572535.239105:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787572535.239323:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787572535.239328:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787572535.240112:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787572535.240119:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787572535.310300:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787572535.310512:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787572535.310518:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787572535.324887:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787572535.324903:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787572535.326307:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787572535.326486:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787572535.326492:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787572535.328111:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787572535.328121:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787572535.332297:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787572535.333590:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787572535.333597:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787572535.335027:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787572535.335039:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787572535.336142:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787572535.336459:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787572535.336464:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787572535.337360:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787572535.337367:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787572535.359040:0:14366:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787572535.359358:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787572535.359365:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787572535.361342:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787572535.361354:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787572535.362311:0:14366:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787572535.362320:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787572535.363009:0:14366:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787572535.363032:0:14366:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787572535.363038:0:14366:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787572535.363167:0:14366:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787572535.363212:0:14366:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.155@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787572535.363216:0:14366:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787572535.363218:0:14366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787572535.363219:0:14366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572535.363220:0:14366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572535.363222:0:14366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572535.363223:0:14366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572535.363224:0:14366:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787572535.363226:0:14366:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787572535.363227:0:14366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572535.363228:0:14366:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787572535.363231:0:14366:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787572535.363233:0:14366:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787572535.363234:0:14366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787572535.363235:0:14366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572535.363236:0:14366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572535.363237:0:14366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572535.363238:0:14366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572535.363239:0:14366:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787572535.363243:0:14366:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787572535.363244:0:14366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572535.363245:0:14366:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787572535.363272:0:14366:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787572535.363289:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481408:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787572535.363361:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.363459:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.363541:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268481408 00000100:00100000:2.0:1787572535.363554:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268481408 00000100:00100000:2.0:1787572535.363673:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572535.363682:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+5:14366:x1874405268481408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787572535.363727:0:14379:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787572535.363729:0:14379:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787572535.363732:0:14379:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787572535.363986:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787572535.364349:0:14379:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787572535.365425:0:14400:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787572535.365431:0:14400:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787572535.365434:0:14400:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787572535.365468:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787572535.365753:0:14379:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787572535.365762:0:14379:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787572535.371916:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+5:14366:x1874405268481408:12345-0@lo:253:mount.lustre.0 Request processed in 8225us (8544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572535.371936:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787572535.372021:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787572535.372037:0:14366:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787572535.372041:0:14366:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787572535.372043:0:14366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787572535.372044:0:14366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572535.372045:0:14366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572535.372047:0:14366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572535.372048:0:14366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572535.372049:0:14366:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787572535.372051:0:14366:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787572535.372054:0:14366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572535.372055:0:14366:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787572535.372074:0:14366:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d1f4534000 from lustre-MDT0000 10000000:01000000:1.0:1787572535.372101:0:14366:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787572535.372104:0:14366:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787572535.372109:0:14366:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98d1d5ed0000 10000000:01000000:1.0:1787572535.372113:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787572535.372121:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d1d5ed0000 from 1 10000000:01000000:1.0:1787572535.372124:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787572535.372160:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.372253:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.372266:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.372305:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572535.372344:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.373011:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.373091:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268481536 00000100:00100000:2.0:1787572535.373099:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268481536 00000100:00100000:2.0:1787572535.373184:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572535.373206:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+5:14366:x1874405268481536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787572535.373218:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572535.373234:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc277a00/0x9fe530ef4f437321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43731a expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.373272:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc277a00/0x9fe530ef4f437321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43731a expref: 6 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.373283:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc277a00/0x9fe530ef4f437321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43731a expref: 6 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.373293:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277a00, rc 0) 00000100:00100000:2.0:1787572535.373337:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+6:14366:x1874405268481536:12345-0@lo:101:mount.lustre.0 Request processed in 144us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.373343:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787572535.373410:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572535.373424:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.373433:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.373480:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572535.373507:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.373674:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572535.373870:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268481664 00000100:00100000:0.0:1787572535.373876:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268481664 00000100:00100000:0.0:1787572535.373901:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787572535.373909:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+6:14366:x1874405268481664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572535.374121:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+6:14366:x1874405268481664:12345-0@lo:501:mount.lustre.0 Request processed in 213us (613us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787572535.374129:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572535.374242:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481664:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787572535.374269:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787572535.374287:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.374296:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572535.374305:0:14366:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d1f4534000 10000000:01000000:1.0:1787572535.374311:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787572535.374315:0:14366:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98d1f4534000 10000000:01000000:1.0:1787572535.374318:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787572535.374321:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98d1f4534000 from 1 10000000:01000000:1.0:1787572535.374332:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787572535.374354:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f437328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.374362:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f437328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.374370:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f437328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.374384:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572535.374411:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.374431:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572535.374539:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268481792 00000100:00100000:0.0:1787572535.374544:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268481792 00000100:00100000:0.0:1787572535.374563:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787572535.374570:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+6:14366:x1874405268481792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787572535.374577:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572535.374589:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4671c00/0x9fe530ef4f43732f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437328 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572535.374617:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671c00/0x9fe530ef4f43732f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437328 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572535.374626:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4671c00/0x9fe530ef4f43732f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437328 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572535.374661:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671c00, rc 0) 00000100:00100000:0.0:1787572535.374694:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+7:14366:x1874405268481792:12345-0@lo:101:mount.lustre.0 Request processed in 125us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572535.374700:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787572535.374868:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572535.374880:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f437328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43732f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.374888:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f437328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43732f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572535.374900:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787572535.374914:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f437328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43732f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.374921:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0030600/0x9fe530ef4f437328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43732f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572535.374927:0:14366:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787572535.374930:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787572535.374940:0:14366:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98d1f4534000 10000000:01000000:1.0:1787572535.374942:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787572535.374945:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787572535.374947:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787572535.374962:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f437336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.374969:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f437336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.374975:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f437336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.374987:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572535.375012:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.375028:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572535.375082:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268481920 00000100:00100000:0.0:1787572535.375086:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268481920 00000100:00100000:0.0:1787572535.375105:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787572535.375111:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+7:14366:x1874405268481920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787572535.375118:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572535.375125:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670600/0x9fe530ef4f43733d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437336 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572535.375138:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670600/0x9fe530ef4f43733d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437336 expref: 8 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572535.375146:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670600/0x9fe530ef4f43733d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437336 expref: 8 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572535.375159:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670600, rc 0) 00000100:00100000:0.0:1787572535.375213:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+8:14366:x1874405268481920:12345-0@lo:101:mount.lustre.0 Request processed in 102us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572535.375219:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787572535.375348:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268481920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572535.375359:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f437336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43733d expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.375366:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f437336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43733d expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.375405:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268482048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572535.375428:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.375448:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572535.375498:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268482048 00000100:00100000:0.0:1787572535.375502:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268482048 00000100:00100000:0.0:1787572535.375521:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787572535.375527:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+8:14366:x1874405268482048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572535.375980:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+9:14366:x1874405268482048:12345-0@lo:501:mount.lustre.0 Request processed in 451us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572535.375988:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787572535.376073:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268482048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572535.376101:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268482176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787572535.376144:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.376170:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572535.376499:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268482176 00000100:00100000:0.0:1787572535.376504:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268482176 00000100:00100000:0.0:1787572535.376527:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787572535.376534:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+9:14366:x1874405268482176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787572535.376952:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+9:14366:x1874405268482176:12345-0@lo:503:mount.lustre.0 Request processed in 418us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572535.376960:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787572535.377139:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268482176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787572535.378025:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14401:1874405268482304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572535.378075:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.378146:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572535.378259:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268482304 00000100:00100000:0.0:1787572535.378265:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268482304 00000100:00100000:0.0:1787572535.378342:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787572535.378352:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+9:14401:x1874405268482304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572535.378631:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+9:14401:x1874405268482304:12345-0@lo:502:llog_process_th.0 Request processed in 280us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572535.378810:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14401:1874405268482304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787572535.378838:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572535.378850:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.378852:0:14401:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787572535.378857:0:14401:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787572535.378860:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787572535.378874:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98d1d5ed4d28) 00000020:00000080:1.0:1787572535.378894:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787572535.378899:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787572535.378962:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787572535.378971:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f43734b 00000020:00000080:1.0:1787572535.379203:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787572535.379207:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572535.379211:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.379213:0:14401:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787572535.379215:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572535.379219:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.379220:0:14401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787572535.379223:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787572535.379231:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98d1d5ed19b8) 00000020:00000080:1.0:1787572535.379241:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787572535.379244:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787572535.379246:0:14401:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787572535.379255:0:14401:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787572535.379262:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787572535.379306:0:14401:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d1f4534000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787572535.379320:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98d1d5ed3370) 00000020:00000080:1.0:1787572535.379329:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787572535.379383:0:14401:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787572535.379389:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f437360 00000020:00000080:1.0:1787572535.379481:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787572535.379487:0:14401:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787572535.379492:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9fe530ef4f437367 00080000:01000000:1.0:1787572535.379497:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787572535.379501:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f43736e 00000100:00100000:0.0:1787572535.380782:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787572535.519770:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787572535.520248:0:14401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787572535.520655:0:14401:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787572535.521499:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98d1fab3cd28) 00000020:00000080:1.0:1787572535.521522:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787572535.521586:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787572535.521592:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f43737c 00000020:00000080:0.0:1787572535.522135:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787572535.525755:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9fe530ef4f437383 00000020:00000080:1.0:1787572535.526708:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787572535.526719:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572535.526726:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.526729:0:14401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787572535.526731:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787572535.526734:0:14401:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787572535.526735:0:14401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787572535.526737:0:14401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787572535.526738:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787572535.526740:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.526742:0:14401:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787572535.526744:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787572535.526750:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.526751:0:14401:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787572535.526762:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787572535.526803:0:14401:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787572535.526824:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572535.526827:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.526829:0:14401:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787572535.526831:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787572535.526835:0:14401:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787572535.526838:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.526839:0:14401:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787572535.526842:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787572535.526848:0:14401:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.155@tcp to nid 0x20000c0a8cc9b (192.168.204.155@tcp) 00000020:01000000:1.0:1787572535.526874:0:14401:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787572535.526877:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787572535.526891:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98d1fab399b8) 00000020:00000080:1.0:1787572535.526905:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787572535.526910:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787572535.526974:0:14401:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787572535.526979:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787572535.526985:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f437391 00010000:00080000:1.0:1787572535.527015:0:14401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d1d16bf800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1787572535.527256:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787572535.530001:0:14401:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787572535.530052:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787572535.535887:0:14401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787572535.535982:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787572535.537554:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787572535.542313:0:14405:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787572535.542322:0:14405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787572535.543261:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787572535.543275:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787572535.543310:0:14401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787572535.543331:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f437398 00000100:00080000:0.0:1787572535.543342:0:14401:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787572535.543348:0:14401:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98d1d16bf800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1787572535.543386:0:14401:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c6ccf100 x1874405268482432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787572535.543458:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268482432:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787572535.543532:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874405268482432 offset 0 length 520: 4 00000100:00080000:0.0:1787572535.543607:0:14401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787572535.543713:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572535.543717:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572535.543719:0:14401:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787572535.543722:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787572535.543724:0:14401:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787572535.543726:0:14401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787572535.543728:0:14401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787572535.543729:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787572535.543732:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572535.543733:0:14401:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787572535.543736:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787572535.543740:0:14401:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787572535.543744:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572535.543746:0:14401:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787572535.543748:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787572535.543752:0:14401:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.155@tcp to nid 0x20000c0a8cc9b (192.168.204.155@tcp) 00000020:01000000:0.0:1787572535.543774:0:14401:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787572535.543776:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787572535.543789:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98d1f3c699b8) 00000020:00000080:0.0:1787572535.543801:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787572535.543813:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787572535.543873:0:14401:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787572535.543879:0:14401:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787572535.543885:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9fe530ef4f4373a6 00010000:00080000:0.0:1787572535.543913:0:14401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d1de1f6800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:0.0:1787572535.544122:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787572535.544323:0:14401:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787572535.544346:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787572535.544891:0:14401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787572535.544972:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787572535.545049:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787572535.546048:0:14407:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787572535.546056:0:14407:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787572535.546553:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787572535.546562:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787572535.546592:0:14401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787572535.546612:0:14401:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f4373ad 00000100:00080000:0.0:1787572535.546622:0:14401:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787572535.546628:0:14401:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d1de1f6800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1787572535.546817:0:14401:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c6ccea00 x1874405268482560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787572535.546872:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268482560:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787572535.546926:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874405268482560 offset 0 length 520: 4 00000100:00080000:0.0:1787572535.546979:0:14401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787572535.547065:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572535.547070:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572535.547072:0:14401:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787572535.547074:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572535.547079:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572535.547080:0:14401:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787572535.547083:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787572535.547085:0:14401:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787572535.547087:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572535.547099:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572535.547101:0:14401:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787572535.547103:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572535.547106:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572535.547107:0:14401:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787572535.547111:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787572535.547138:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14401:1874405268482688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572535.547200:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572535.547225:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fbeb3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.547348:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268482688 00000100:00100000:2.0:1787572535.547354:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268482688 00000100:00100000:2.0:1787572535.547435:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787572535.547445:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+9:14401:x1874405268482688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572535.547718:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+9:14401:x1874405268482688:12345-0@lo:502:llog_process_th.0 Request processed in 273us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.547726:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787572535.547821:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14401:1874405268482688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787572535.547848:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787572535.547853:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787572535.547855:0:14401:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787572535.547860:0:14401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787572535.548104:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787572535.548124:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787572535.548177:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f437336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43733d expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.548186:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0030200/0x9fe530ef4f437336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43733d expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572535.548204:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d1f4534000 from 1 10000000:01000000:2.0:1787572535.548207:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787572535.548236:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.548243:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.548252:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572535.548266:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc703800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268482816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787572535.548301:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572535.548332:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f3e4e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572535.548391:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268482816 00000100:00100000:1.0:1787572535.548396:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268482816 00000100:00100000:1.0:1787572535.548431:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787572535.548438:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+9:14366:x1874405268482816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572535.548448:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572535.548462:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4373b4 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.548480:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.548489:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.548498:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c0030e00, rc 0) 00000100:00100000:1.0:1787572535.548541:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+10:14366:x1874405268482816:12345-0@lo:101:mount.lustre.0 Request processed in 103us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572535.548548:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787572535.548612:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc703800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268482816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787572535.548625:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572535.548661:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572535.549219:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268482944:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787572535.549257:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572535.549273:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.549702:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268482944 00000100:00100000:2.0:1787572535.549708:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268482944 00000100:00100000:2.0:1787572535.549738:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787572535.549746:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+10:14366:x1874405268482944:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787572535.549762:0:14378:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787572535.549769:0:14378:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787572535.549835:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+10:14366:x1874405268482944:12345-0@lo:256:mount.lustre.0 Request processed in 89us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.549841:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787572535.549978:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268482944:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787572535.550563:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787572535.550873:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572535.550883:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787572535.550891:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1f4534000 from 1 10000000:01000000:3.0:1787572535.550894:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787572535.550931:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572535.550939:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572535.550949:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572535.551021:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787572535.551062:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572535.551099:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.551146:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268483072 00000100:00100000:2.0:1787572535.551153:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268483072 00000100:00100000:2.0:1787572535.551206:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787572535.551214:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+10:14366:x1874405268483072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787572535.551225:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572535.551238:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4373c2 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.551258:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.551266:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.551275:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276c00, rc 0) 00000100:00100000:2.0:1787572535.551315:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14366:x1874405268483072:12345-0@lo:101:mount.lustre.0 Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.551330:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787572535.551406:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572535.551420:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.551427:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.551478:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572535.551504:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.551527:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.551574:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268483200 00000100:00100000:2.0:1787572535.551579:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268483200 00000100:00100000:2.0:1787572535.551600:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572535.551606:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14366:x1874405268483200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787572535.552006:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14366:x1874405268483200:12345-0@lo:501:mount.lustre.0 Request processed in 398us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.552012:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787572535.552099:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572535.552128:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787572535.552166:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.552204:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.552242:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268483328 00000100:00100000:2.0:1787572535.552246:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268483328 00000100:00100000:2.0:1787572535.552272:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787572535.552277:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14366:x1874405268483328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787572535.552460:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14366:x1874405268483328:12345-0@lo:503:mount.lustre.0 Request processed in 181us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.552467:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787572535.552720:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787572535.553150:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14409:1874405268483456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572535.553202:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572535.553262:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.553300:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268483456 00000100:00100000:2.0:1787572535.553306:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268483456 00000100:00100000:2.0:1787572535.553376:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787572535.553386:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14409:x1874405268483456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572535.553591:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14409:x1874405268483456:12345-0@lo:502:llog_process_th.0 Request processed in 206us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.553598:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787572535.553681:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14409:1874405268483456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787572535.553706:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572535.553715:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572535.553717:0:14409:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787572535.553724:0:14409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d1f4534000 00000020:00000080:3.0:1787572535.553726:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787572535.553735:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572535.553738:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572535.553739:0:14409:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787572535.553742:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572535.553744:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572535.553745:0:14409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787572535.553748:0:14409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d1f4534000 00000020:00000080:3.0:1787572535.553749:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787572535.553804:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572535.553808:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572535.553809:0:14409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787572535.553812:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572535.553814:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572535.553815:0:14409:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787572535.553818:0:14409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d1f4534000 00000020:00000080:3.0:1787572535.553820:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787572535.553860:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14409:1874405268483584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572535.553895:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572535.561577:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268483584 00000100:00100000:0.0:1787572535.561595:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268483584 00000100:00100000:0.0:1787572535.561666:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787572535.561677:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14409:x1874405268483584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787572535.562218:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14409:x1874405268483584:12345-0@lo:502:llog_process_th.0 Request processed in 541us (8320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572535.562228:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787572535.563703:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.563738:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14409:1874405268483584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787572535.563778:0:14409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572535.563790:0:14409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572535.563793:0:14409:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787572535.563797:0:14409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787572535.563967:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787572535.563987:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787572535.564005:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.564017:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572535.564062:0:14366:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787572535.564065:0:14366:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d1f4534000 10000000:01000000:1.0:1787572535.564068:0:14366:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d1f4534000 10000000:01000000:1.0:1787572535.564073:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787572535.564079:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d1f4534000 from 1 10000000:01000000:1.0:1787572535.564082:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787572535.564114:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031e00/0x9fe530ef4f4373d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.564123:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0031e00/0x9fe530ef4f4373d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.564133:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0031e00/0x9fe530ef4f4373d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.564154:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572535.564234:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.564311:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.566631:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268483712 00000100:00100000:2.0:1787572535.566659:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268483712 00000100:00100000:2.0:1787572535.566745:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787572535.566759:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14366:x1874405268483712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787572535.566777:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572535.566795:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc277800/0x9fe530ef4f4373d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4373d0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.566823:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc277800/0x9fe530ef4f4373d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4373d0 expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.566834:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc277800/0x9fe530ef4f4373d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4373d0 expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.566844:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277800, rc 0) 00000100:00100000:2.0:1787572535.566921:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14366:x1874405268483712:12345-0@lo:101:mount.lustre.0 Request processed in 165us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.566928:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787572535.567049:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572535.567078:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0031e00/0x9fe530ef4f4373d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373d7 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.567089:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031e00/0x9fe530ef4f4373d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4373d7 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.567152:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572535.567183:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.567230:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787572535.568448:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268483840 00000100:00100000:0.0:1787572535.568459:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268483840 00000100:00100000:0.0:1787572535.568513:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787572535.568523:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14366:x1874405268483840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572535.571306:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14366:x1874405268483840:12345-0@lo:501:mount.lustre.0 Request processed in 2777us (4114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572535.571321:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787572535.572275:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572535.572339:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787572535.572394:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572535.572569:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fbeb3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787572535.573009:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268483968 00000100:00100000:3.0:1787572535.573018:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268483968 00000100:00100000:0.0:1787572535.573229:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787572535.573240:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14366:x1874405268483968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787572535.573463:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14366:x1874405268483968:12345-0@lo:503:mount.lustre.0 Request processed in 226us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572535.573476:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787572535.573554:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268483968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787572535.575231:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14414:1874405268484096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572535.575292:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572535.575333:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96840 going to sleep for 11 seconds 00000100:00100000:1.0:1787572535.575518:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268484096 00000100:00100000:1.0:1787572535.575530:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268484096 00000100:00100000:1.0:1787572535.575580:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787572535.575588:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14414:x1874405268484096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787572535.575862:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14414:x1874405268484096:12345-0@lo:502:llog_process_th.0 Request processed in 274us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572535.575870:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787572535.575920:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14414:1874405268484096:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787572535.575981:0:14414:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787572535.576001:0:14414:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98d1fab38000) 00000020:00000080:1.0:1787572535.576025:0:14414:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787572535.576094:0:14414:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d1f4534000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787572535.576099:0:14414:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d1f4534000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787572535.576101:0:14414:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d1f4534000 4 00010000:00080000:1.0:1787572535.576130:0:14414:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d1ce6ba000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1787572535.577897:0:14414:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787572535.578669:0:14414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787572535.578708:0:14414:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787572535.579399:0:14414:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9fe530ef4f4373e5 00000100:00080000:1.0:1787572535.579412:0:14414:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787572535.579418:0:14414:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98d1ce6ba000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1787572535.579452:0:14414:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1f4529180 x1874405268484224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787572535.579477:0:14414:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787572535.579803:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268484224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787572535.579873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572535.580589:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268484224 00000100:00100000:3.0:1787572535.580599:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268484224 00000100:00100000:3.0:1787572535.580662:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572535.580671:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874405268484224:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787572535.580693:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14414:1874405268484352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787572535.580730:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874405268484224:12345-0@lo:38:llog_process_th.0 Request processed in 59us (857us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787572535.580736:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572535.581045:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787572535.581056:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1ce6ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787572535.581060:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787572535.581063:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268484224:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787572535.581138:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.581168:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572535.581226:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268484352 00000100:00100000:2.0:1787572535.581236:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268484352 00000100:00100000:2.0:1787572535.581307:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787572535.581315:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14414:x1874405268484352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787572535.581553:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14414:x1874405268484352:12345-0@lo:502:llog_process_th.0 Request processed in 239us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572535.581561:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787572535.581627:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39be3db9-5eba-42e2-9087-a4df3ec904cb:14414:1874405268484352:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787572535.581680:0:14414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787572535.581752:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787572535.581770:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787572535.581788:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031e00/0x9fe530ef4f4373d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373d7 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572535.581798:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031e00/0x9fe530ef4f4373d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373d7 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787572535.581845:0:14366:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787572535.581847:0:14366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787572535.581848:0:14366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572535.581849:0:14366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572535.581850:0:14366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572535.581852:0:14366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572535.581854:0:14366:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787572535.581855:0:14366:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787572535.581857:0:14366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572535.581858:0:14366:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787572535.581862:0:14366:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787572535.581864:0:14366:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787572535.581865:0:14366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787572535.581867:0:14366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572535.581868:0:14366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572535.581869:0:14366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572535.581870:0:14366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572535.581871:0:14366:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787572535.581873:0:14366:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787572535.581874:0:14366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572535.581875:0:14366:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787572535.581890:0:14366:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787572535.581901:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268484480:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787572535.581940:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572535.582137:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c6b630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572535.582343:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268484480 00000100:00100000:1.0:1787572535.582349:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268484480 00000100:00100000:1.0:1787572535.582388:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787572535.582396:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14366:x1874405268484480:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787572535.582418:0:14378:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787572535.582431:0:14378:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787572535.641891:0:14378:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787572535.641917:0:14378:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787572535.642252:0:14399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787572535.642257:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787572535.642279:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.642299:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.642307:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.642349:0:14399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.642363:0:14399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 12 pid: 14376 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572535.642376:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874405268484608:0@lo:104: 00000100:00100000:2.0:1787572535.642446:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572535.642494:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e12ca900 going to sleep for 11 seconds 00000100:00100000:1.0:1787572535.642726:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268484608 00000100:00100000:1.0:1787572535.642735:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268484608 00000100:00100000:1.0:1787572535.642822:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787572535.642832:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:14399:x1874405268484608:12345-0@lo:104: 00010000:00010000:1.0:1787572535.642845:0:14367:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.642913:0:14367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787572535.642919:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:14399:x1874405268484608:12345-0@lo:104: Request processed in 89us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572535.642927:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572535.642994:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874405268484608:0@lo:104: 00010000:00010000:2.0:1787572535.643014:0:14399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.643285:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572535.643292:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.643299:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:2.0:1787572535.643303:0:14373:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.643310:0:14373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787572535.643316:0:14373:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572535.643322:0:14373:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787572535.643360:0:14373:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.643367:0:14373:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787572535.643387:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.643394:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1fc277600/0x9fe530ef4f4373b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.643409:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572535.643411:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572535.643413:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572535.643439:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39be3db9-5eba-42e2-9087-a4df3ec904cb:3313:1874405268484736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787572535.643477:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572535.643943:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268484736 00000100:00100000:1.0:1787572535.643949:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268484736 00010000:00010000:1.0:1787572535.643968:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 13 pid: 14376 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572535.644003:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787572535.644011:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+13:3313:x1874405268484736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572535.644022:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572535.644027:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 13 pid: 14376 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644037:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 13 pid: 14376 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644049:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1c0030e00/0x9fe530ef4f4373bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4373b4 expref: 13 pid: 14376 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644062:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644076:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787572535.644088:0:14369:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001831941s 00010000:00010000:1.0:1787572535.644092:0:14369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644099:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644105:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644112:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644117:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572535.644121:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644127:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644147:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572535.644157:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572535.644208:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:3313:x1874405268484736:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572535.644215:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787572535.644252:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39be3db9-5eba-42e2-9087-a4df3ec904cb:3313:1874405268484736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572535.644342:0:14399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.644350:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572535.644356:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc276200/0x9fe530ef4f4373ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572535.651712:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14366:x1874405268484480:12345-0@lo:253:mount.lustre.0 Request processed in 69306us (69760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572535.651727:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787572535.651837:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:14366:1874405268484480:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787572535.651853:0:14366:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787572535.651856:0:14366:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787572535.651858:0:14366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787572535.651859:0:14366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572535.651861:0:14366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572535.651862:0:14366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572535.651863:0:14366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572535.651864:0:14366:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787572535.651865:0:14366:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787572535.651867:0:14366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572535.651868:0:14366:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787572535.651881:0:14366:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787572535.656857:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787572535.657031:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787572535.657333:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787572535.657493:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787572535.657878:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787572535.658037:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787572535.659244:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787572535.659410:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787572535.659877:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787572535.660105:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787572535.660383:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787572535.660540:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787572535.696352:0:14366:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787572535.697121:0:14366:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787572535.698250:0:14421:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787572535.698337:0:14421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787572535.703478:0:14366:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787572535.703676:0:14366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787572535.709399:0:14421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787572535.709487:0:14421:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787572535.709491:0:14421:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:0.0:1787572535.710074:0:14420:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787572535.710079:0:14420:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:1.0:1787572535.710576:0:14366:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787572535.710592:0:14366:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787572535.711174:0:14366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787572535.712385:0:14366:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787572535.713518:0:14366:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787572535.713571:0:14366:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787572535.719478:0:14366:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787572535.730258:0:14366:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787572535.761381:0:14366:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787572535.761427:0:14366:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa61841c93988 00100000:10000000:1.0:1787572535.761435:0:14366:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787572535.764250:0:14366:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787572535.764266:0:14366:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787572535.764286:0:14366:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787572535.764304:0:14366:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787572536.174843:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787572536.626103:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787572537.006791:0:14381:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787572537.006807:0:14381:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d1f4534000 from 6 10000000:01000000:3.0:1787572537.006815:0:14381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787572537.006902:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572537.006944:0:14381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572537.006961:0:14381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572537.007001:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268484864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787572537.008009:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572537.008116:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268484864 00000100:00100000:0.0:1787572537.008144:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268484864 00000100:00100000:0.0:1787572537.008223:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787572537.008249:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14381:x1874405268484864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572537.008268:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572537.008289:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4373f3 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572537.008318:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572537.008330:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572537.008338:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671800, rc 0) 00000100:00100000:0.0:1787572537.016447:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14381:x1874405268484864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8189us (8434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572537.016463:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787572537.019841:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787572537.019907:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268484864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572537.019947:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572537.019965:0:14381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572537.020234:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268484992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787572537.020360:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572537.020408:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5a96d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787572537.020973:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268484992 00000100:00100000:1.0:1787572537.020992:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268484992 00000100:00100000:1.0:1787572537.021114:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787572537.021124:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14381:x1874405268484992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787572537.021148:0:14378:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787572537.021191:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787572537.021195:0:14378:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787572537.021862:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14381:x1874405268484992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 738us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572537.021872:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787572537.026932:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268484992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787572537.027090:0:14381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787572537.027101:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572537.027113:0:14381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572537.198813:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787572537.654078:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787572538.225963:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572539.250854:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787572539.942320:0:14664:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787572540.270965:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787572540.912067:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787572540.912075:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787572540.912077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787572540.912081:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787572540.912083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787572540.912097:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787572540.912101:0:8:0:(import.c:65:import_set_state_nolock()) ffff98d1ce6ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787572540.912115:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98d1ce6ba000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1787572540.912141:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1f4529880 x1874405268485248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787572540.912188:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268485248:0@lo:38:kworker.0 00000100:00100000:2.0:1787572540.912313:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268485120:0@lo:400:kworker.0 00000100:00100000:2.0:1787572540.912870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572540.912940:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268485120 00000100:00100000:0.0:1787572540.912948:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268485120 00000100:00100000:0.0:1787572540.913001:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787572540.913011:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:3310:x1874405268485120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572540.913079:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:3310:x1874405268485120:12345-0@lo:400:kworker.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572540.913101:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787572540.913150:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268485120:0@lo:400:kworker.0 00000100:00100000:1.0:1787572540.914034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572540.914220:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268485248 00000100:00100000:0.0:1787572540.914227:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268485248 00000100:00100000:0.0:1787572540.914669:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787572540.914676:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874405268485248:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787572540.914703:0:14385:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:0.0:1787572540.914743:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9fe530ef4f437401 00000004:00100000:0.0:1787572540.914759:0:14385:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787572540.916258:0:14385:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787572540.916361:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874405268485248:12345-0@lo:38:kworker.0 Request processed in 1683us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572540.916371:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787572540.918698:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d1f4529880 x1874405268485248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787572550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787572540.918720:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787572540.918730:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787572540.918736:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787572540.918740:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1ce6ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787572540.918749:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874405268485248:0@lo:38:kworker.0 00010000:00010000:1.0:1787572541.295825:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572542.319340:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787572542.754404:0:14815:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3e950dd0 20000000:00000080:1.0:1787572542.754425:0:14815:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d1efc89c00 uarg=0000000000000000 20000000:01000000:1.0:1787572542.754459:0:14815:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787572542.754467:0:14815:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787572542.754472:0:14815:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787572542.762187:0:14816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787572542.762592:0:14815:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787572542.781976:0:14815:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787572542.784725:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572542.784760:0:14815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572542.784770:0:14815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572542.784829:0:14815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572542.784850:0:14815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 11 pid: 14378 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572542.784883:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14815:1874405268485376:0@lo:104: 00000100:00100000:0.0:1787572542.784959:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572542.785032:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada900 going to sleep for 11 seconds 00000100:00100000:1.0:1787572542.785088:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268485376 00000100:00100000:1.0:1787572542.785096:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268485376 00000100:00100000:1.0:1787572542.785162:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787572542.785173:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:14815:x1874405268485376:12345-0@lo:104: 00010000:00010000:1.0:1787572542.785186:0:14367:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785250:0:14367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787572542.785257:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:14815:x1874405268485376:12345-0@lo:104: Request processed in 86us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572542.785264:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787572542.785286:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572542.785292:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785300:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb800 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572542.785304:0:14373:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785313:0:14373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572542.785320:0:14373:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572542.785337:0:14373:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787572542.785339:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14815:1874405268485376:0@lo:104: 00010000:00010000:1.0:1787572542.785364:0:14373:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572542.785366:0:14815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785371:0:14373:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572542.785394:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572542.785400:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268485504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572542.785401:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1de0eb800/0x9fe530ef4f4373c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785417:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572542.785419:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572542.785421:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572542.785436:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572542.785526:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268485504 00000100:00100000:1.0:1787572542.785531:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268485504 00010000:00010000:1.0:1787572542.785548:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 12 pid: 14378 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572542.785578:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787572542.785585:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:3311:x1874405268485504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572542.785595:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572542.785600:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 12 pid: 14378 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785610:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 12 pid: 14378 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785622:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc276c00/0x9fe530ef4f4373c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4373c2 expref: 12 pid: 14378 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785663:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785671:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785686:0:14369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785693:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785700:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785705:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785713:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572542.785717:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785724:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785747:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572542.785756:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572542.785954:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:3311:x1874405268485504:12345-0@lo:103:ldlm_bl.0 Request processed in 369us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572542.785967:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787572542.786020:0:14815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572542.786028:0:14815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572542.786034:0:14815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f437408 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572542.787430:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268485504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787572543.344859:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787572543.984267:0:14381:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787572543.984297:0:14381:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1f4534000 from 10 10000000:01000000:2.0:1787572543.984304:0:14381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787572543.984380:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572543.984558:0:14381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572543.984575:0:14381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572543.984615:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc702a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268485632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572543.984805:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572543.984943:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d09bef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572543.986271:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268485632 00000100:00100000:0.0:1787572543.986287:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268485632 00000100:00100000:0.0:1787572543.986357:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787572543.986369:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+11:14381:x1874405268485632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572543.986390:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572543.986869:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43740f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572543.986914:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572543.986927:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572543.986938:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670000, rc 0) 00000100:00100000:0.0:1787572543.987053:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14381:x1874405268485632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 686us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572543.987060:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787572543.987229:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc702a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268485632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572543.987251:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572543.987269:0:14381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572543.987370:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268485760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572543.987871:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572543.987909:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572543.987928:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268485760 00000100:00100000:0.0:1787572543.987935:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268485760 00000100:00100000:0.0:1787572543.987974:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787572543.987984:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14381:x1874405268485760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572543.988300:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14381:x1874405268485760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572543.988308:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787572543.988371:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268485760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572543.988439:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268485888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572543.989120:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572543.989158:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572543.993252:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268485888 00000100:00100000:1.0:1787572543.993272:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268485888 00000100:00100000:1.0:1787572543.993483:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787572543.993497:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14381:x1874405268485888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572543.994133:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:14381:x1874405268485888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 635us (5018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572543.994144:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787572543.994270:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268485888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787572543.998812:0:14856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787572543.999001:0:14381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787572543.999060:0:14381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787572543.999076:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572543.999206:0:14381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572544.366885:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572545.006823:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787572535/real 1787572535] req@ffff98d0c6ccea00 x1874405268482560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787572545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572545.006857:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d0c6ccea00 x1874405268482560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787572545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572545.006869:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787572535/real 1787572535] req@ffff98d0c6ccf100 x1874405268482432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787572545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572545.006882:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d0c6ccf100 x1874405268482432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787572545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787572545.006902:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787572545.006930:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787572545.006955:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268482560:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787572545.006962:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1d16bf800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787572545.006968:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787572545.006972:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268482432:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787572545.007181:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787572545.007185:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787572545.007188:0:8:0:(import.c:65:import_set_state_nolock()) ffff98d1d16bf800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787572545.007199:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:3.0:1787572545.007204:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787572545.007210:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98d1d16bf800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:3.0:1787572545.007231:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c6249500 x1874405268486144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787572545.007244:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787572545.007247:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787572545.007248:0:8:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787572545.007251:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:3.0:1787572545.007254:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787572545.007257:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d1de1f6800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:3.0:1787572545.007268:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c624bb80 x1874405268486272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787572545.007567:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39be3db9-5eba-42e2-9087-a4df3ec904cb:3312:1874405268486016:0@lo:400:kworker.0 00000100:00100000:2.0:1787572545.007668:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572545.007728:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572545.007735:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268486400:0@lo:400:kworker.0 00000100:00100000:2.0:1787572545.007763:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572545.007805:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268486144:0@lo:8:kworker.0 00000400:00000100:2.0:1787572545.007828:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874405268486144 offset 0 length 520: 4 00000100:00100000:2.0:1787572545.007840:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268486272:0@lo:8:kworker.0 00000400:00000100:2.0:1787572545.007874:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874405268486272 offset 0 length 520: 4 00000100:00100000:3.0:1787572545.008080:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268486016 00000100:00100000:3.0:1787572545.008088:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268486016 00000100:00100000:3.0:1787572545.008139:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787572545.008149:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:3312:x1874405268486016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572545.008198:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:3312:x1874405268486016:12345-0@lo:400:kworker.0 Request processed in 50us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572545.008206:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787572545.008296:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39be3db9-5eba-42e2-9087-a4df3ec904cb:3312:1874405268486016:0@lo:400:kworker.0 00000100:00100000:0.0:1787572545.010809:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268486400 00000100:00100000:0.0:1787572545.010823:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268486400 00000100:00100000:0.0:1787572545.010889:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787572545.010900:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268486400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572545.010996:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268486400:12345-0@lo:400:kworker.0 Request processed in 98us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572545.011004:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787572545.011188:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d0c624a680 x1874405268486400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572545.011215:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268486400:0@lo:400:kworker.0 00010000:00010000:0.0:1787572545.393375:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572546.414964:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572547.448555:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787572547.889971:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1787572547.991882:0:15064:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787572547.991887:0:15064:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787572547.992036:0:15064:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d0c52f5800 00000020:01000004:1.0:1787572547.992169:0:15064:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787572547.992184:0:15064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787572547.992199:0:15064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98d1fab3b370) 00000020:00000080:1.0:1787572547.992222:0:15064:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787572548.017975:0:15064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787572548.018250:0:15064:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787572548.022798:0:15064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787572548.023578:0:15064:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787572548.023842:0:15064:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787572548.024221:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 517: rc = 0 00100000:10000000:2.0:1787572548.024514:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 517: rc = 0 00100000:10000000:2.0:1787572548.024604:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:2.0:1787572548.025670:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 659: rc = 0 00100000:10000000:2.0:1787572548.025978:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 659: rc = 0 00100000:10000000:2.0:1787572548.026372:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 659: rc = 0 00100000:10000000:2.0:1787572548.026622:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 659: rc = 0 00100000:10000000:2.0:1787572548.033017:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 659: rc = 0 00100000:10000000:2.0:1787572548.033485:0:15064:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 659: rc = 0 00000020:00000080:2.0:1787572548.034462:0:15064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787572548.034474:0:15064:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787572548.034485:0:15064:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9fe530ef4f437424 00000020:01000004:2.0:1787572548.034494:0:15064:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787572548.034516:0:15064:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787572548.034520:0:15064:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787572548.034526:0:15064:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787572548.034530:0:15064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787572548.034541:0:15064:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98d1de1c99b8) 00000020:00000080:2.0:1787572548.034551:0:15064:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787572548.043475:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787572548.043680:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787572548.043686:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787572548.046262:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787572548.046274:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787572548.049409:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787572548.049433:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787572548.057886:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787572548.058233:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787572548.058240:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787572548.059807:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787572548.059985:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787572548.112977:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787572548.113316:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787572548.113324:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787572548.116806:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787572548.116826:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787572548.119775:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787572548.119794:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787572548.126521:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787572548.127445:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787572548.127453:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787572548.128499:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787572548.128508:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787572548.187089:0:15064:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787572548.187315:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787572548.187322:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787572548.189366:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787572548.189378:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787572548.190237:0:15064:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787572548.190264:0:15064:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787572548.190271:0:15064:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787572548.228451:0:15064:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787572548.228505:0:15064:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.155@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787572548.228510:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787572548.228511:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787572548.228512:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572548.228513:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572548.228514:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572548.228516:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572548.228517:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787572548.228519:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572548.228520:0:15064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787572548.228523:0:15064:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787572548.228525:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787572548.228530:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787572548.228531:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572548.228532:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572548.228533:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572548.228534:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572548.228535:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787572548.228535:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572548.228536:0:15064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787572548.228564:0:15064:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787572548.228582:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268486528:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787572548.229705:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572548.229775:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cebc4240 going to sleep for 11 seconds 00000100:00100000:1.0:1787572548.230024:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268486528 00000100:00100000:1.0:1787572548.230037:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268486528 00000100:00100000:1.0:1787572548.230098:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787572548.230109:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:15064:x1874405268486528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787572548.230174:0:14376:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787572548.230178:0:14376:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787572548.230183:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787572548.235070:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:15064:x1874405268486528:12345-0@lo:253:mount.lustre.0 Request processed in 4952us (5360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572548.235086:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787572548.235192:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268486528:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787572548.235208:0:15064:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787572548.235212:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787572548.235213:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787572548.235215:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787572548.235216:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787572548.235217:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787572548.235219:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787572548.235220:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787572548.235222:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787572548.235223:0:15064:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787572548.235243:0:15064:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d0c52f5800 from lustre-OST0000 10000000:01000000:0.0:1787572548.235267:0:15064:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787572548.235270:0:15064:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787572548.235277:0:15064:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98d1d5ed0000 local copy 00010000:00010000:0.0:1787572548.235287:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572548.235531:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268486656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572548.235570:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572548.235610:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cebc40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572548.235977:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268486656 00000100:00100000:2.0:1787572548.235985:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268486656 00000100:00100000:2.0:1787572548.236045:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787572548.236056:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:15064:x1874405268486656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787572548.236248:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:15064:x1874405268486656:12345-0@lo:501:mount.lustre.0 Request processed in 194us (677us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787572548.236257:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787572548.236337:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268486656:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787572548.236355:0:15064:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787572548.236537:0:15064:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787572548.236550:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.236561:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572548.236586:0:15064:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d0c52f5800 10000000:01000000:1.0:1787572548.236591:0:15064:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787572548.236596:0:15064:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98d1d5ed0000 10000000:01000000:1.0:1787572548.236598:0:15064:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787572548.236602:0:15064:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98d1d5ed0000 from 1 10000000:01000000:1.0:1787572548.236605:0:15064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787572548.236631:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f437432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.236676:0:15064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f437432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.236687:0:15064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f437432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572548.236702:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4528e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268486784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572548.236735:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572548.236760:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c31afb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787572548.236934:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268486784 00000100:00100000:2.0:1787572548.236939:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268486784 00000100:00100000:2.0:1787572548.236986:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787572548.236994:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+12:15064:x1874405268486784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787572548.237003:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572548.237016:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc277400/0x9fe530ef4f437439 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437432 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.237038:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc277400/0x9fe530ef4f437439 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437432 expref: 13 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.237047:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc277400/0x9fe530ef4f437439 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437432 expref: 13 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.237056:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277400, rc 0) 00000100:00100000:2.0:1787572548.237086:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+13:15064:x1874405268486784:12345-0@lo:101:mount.lustre.0 Request processed in 93us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572548.237092:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787572548.237220:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4528e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268486784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572548.237233:0:15064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f437432 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437439 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.237242:0:15064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f437432 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437439 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572548.237267:0:15064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787572548.237284:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f437432 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437439 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.237292:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031000/0x9fe530ef4f437432 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437439 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572548.237299:0:15064:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787572548.237302:0:15064:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787572548.237307:0:15064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787572548.237308:0:15064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787572548.237323:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f437440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.237330:0:15064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f437440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.237338:0:15064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f437440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572548.237350:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4528e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268486912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572548.237376:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572548.237441:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c31afb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787572548.239344:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268486912 00000100:00100000:3.0:1787572548.239359:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268486912 00000100:00100000:3.0:1787572548.239424:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787572548.239436:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+13:15064:x1874405268486912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787572548.239449:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572548.239470:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1de0ea000/0x9fe530ef4f437447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437440 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.239496:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0ea000/0x9fe530ef4f437447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437440 expref: 14 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.239507:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1de0ea000/0x9fe530ef4f437447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437440 expref: 14 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.239517:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea000, rc 0) 00000100:00100000:2.0:1787572548.239969:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4528e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268486912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787572548.239974:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268486912:12345-0@lo:101:mount.lustre.0 Request processed in 267us (2323us total) trans 0 rc 0/0 00010000:00010000:2.0:1787572548.239991:0:15064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f437440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437447 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.240021:0:15064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f437440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437447 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572548.240245:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000040:00080000:2.0:1787572548.240807:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787572548.241592:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787572548.241872:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787572548.241911:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787572548.241957:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787572548.242007:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787572548.242040:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787572548.242072:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787572548.242135:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787572548.242143:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787572548.242209:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787572548.242267:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572548.242312:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787572548.242575:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268487040 00000100:00100000:0.0:1787572548.242593:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268487040 00000100:00100000:0.0:1787572548.242629:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787572548.242655:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572548.243111:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487040:12345-0@lo:501:mount.lustre.0 Request processed in 456us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.243119:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787572548.243568:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787572548.243972:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787572548.244026:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572548.244053:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787572548.244132:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268487168 00000100:00100000:0.0:1787572548.244138:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268487168 00000100:00100000:0.0:1787572548.244184:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787572548.244193:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787572548.245129:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487168:12345-0@lo:503:mount.lustre.0 Request processed in 935us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.245139:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787572548.248529:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487168:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787572548.250596:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787572548.250761:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572548.250869:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572548.250922:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1eb553c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787572548.251022:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268487296 00000100:00100000:3.0:1787572548.251030:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268487296 00000100:00100000:3.0:1787572548.251078:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787572548.251088:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487296:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787572548.251350:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487296:12345-0@lo:502:mount.lustre.0 Request processed in 263us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572548.251368:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787572548.251474:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787572548.251730:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787572548.251789:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787572548.251832:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787572548.251874:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787572548.251907:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787572548.251940:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787572548.251999:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787572548.252033:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787572548.252066:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787572548.252130:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787572548.252171:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787572548.252239:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787572548.252270:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572548.252315:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572548.252342:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1eb553c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787572548.252599:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268487424 00000100:00100000:1.0:1787572548.252605:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268487424 00000100:00100000:1.0:1787572548.252665:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787572548.252674:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787572548.252866:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487424:12345-0@lo:502:mount.lustre.0 Request processed in 192us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572548.252880:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787572548.253121:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787572548.253195:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787572548.253205:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787572548.254794:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787572548.254805:0:15078:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787572548.254824:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572548.254826:0:15078:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787572548.254833:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787572548.254848:0:15078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98d1de1c8000) 00000020:00000080:2.0:1787572548.254869:0:15078:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787572548.254875:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787572548.254965:0:15078:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d0c52f5800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787572548.254972:0:15078:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787572548.254979:0:15078:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9fe530ef4f437455 00010000:00010000:3.0:1787572548.266506:0:15078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787572548.267056:0:15078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787572548.269570:0:15078:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787572548.271499:0:15078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787572548.271515:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572548.271522:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572548.271524:0:15078:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787572548.271529:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787572548.271532:0:15078:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787572548.271534:0:15078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787572548.271535:0:15078:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787572548.271537:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787572548.271539:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572548.271541:0:15078:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787572548.271543:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572548.271546:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572548.271548:0:15078:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787572548.271551:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787572548.271553:0:15078:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787572548.271555:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572548.271566:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572548.271567:0:15078:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787572548.271571:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787572548.271573:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572548.271574:0:15078:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787572548.271577:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787572548.271670:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787572548.271674:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572548.271676:0:15078:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787572548.271680:0:15078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787572548.271960:0:15064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787572548.271986:0:15064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787572548.272008:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f437440 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437447 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.272020:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031200/0x9fe530ef4f437440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437447 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572548.272028:0:15064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d0c52f5800 from 1 10000000:01000000:1.0:1787572548.272031:0:15064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787572548.272067:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.272075:0:15064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.272086:0:15064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572548.272107:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572548.272175:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572548.272217:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4bba240 going to sleep for 11 seconds 00000100:00100000:3.0:1787572548.276377:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268487552 00000100:00100000:3.0:1787572548.276393:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268487552 00000100:00100000:3.0:1787572548.276465:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787572548.276476:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+14:15064:x1874405268487552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787572548.276493:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572548.276512:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43745c expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.276540:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 15 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.276551:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 15 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.276561:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb200, rc 0) 00000100:00100000:3.0:1787572548.276675:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268487552:12345-0@lo:101:mount.lustre.0 Request processed in 200us (4499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572548.276681:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787572548.277555:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572548.277578:0:15064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.277598:0:15064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787572548.280209:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787572548.281120:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787572548.281419:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787572548.281468:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787572548.281549:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787572548.281558:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787572548.281762:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572548.282900:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572548.282989:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4bba240 going to sleep for 11 seconds 00000100:00100000:0.0:1787572548.285224:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268487680 00000100:00100000:0.0:1787572548.285239:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268487680 00000100:00100000:0.0:1787572548.285303:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787572548.285316:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268487680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572548.285900:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268487680:12345-0@lo:501:mount.lustre.0 Request processed in 585us (3000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.285909:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787572548.286023:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572548.286074:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787572548.286122:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572548.286158:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4bba240 going to sleep for 11 seconds 00000100:00100000:3.0:1787572548.286203:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268487808 00000100:00100000:3.0:1787572548.286208:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268487808 00000100:00100000:3.0:1787572548.286243:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787572548.286251:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268487808:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787572548.286423:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268487808:12345-0@lo:503:mount.lustre.0 Request processed in 172us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572548.286437:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787572548.286580:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487808:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787572548.287188:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787572548.287255:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572548.287308:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572548.287331:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1eb553c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787572548.287574:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268487936 00000100:00100000:0.0:1787572548.287581:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268487936 00000100:00100000:0.0:1787572548.287621:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787572548.287630:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268487936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787572548.287880:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268487936:12345-0@lo:502:mount.lustre.0 Request processed in 250us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.287888:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787572548.288079:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268487936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787572548.288307:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787572548.288356:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787572548.288477:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787572548.288518:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787572548.288553:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787572548.288602:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787572548.289230:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787572548.289270:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787572548.289309:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572548.289363:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572548.289501:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c4f1b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787572548.294086:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268488064 00000100:00100000:0.0:1787572548.294105:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268488064 00000100:00100000:0.0:1787572548.294221:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787572548.294233:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268488064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787572548.294618:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268488064:12345-0@lo:502:mount.lustre.0 Request processed in 384us (5252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.294659:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787572548.299069:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787572548.299291:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787572548.299306:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787572548.310395:0:15082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787572548.310420:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572548.310422:0:15082:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787572548.310429:0:15082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d0c52f5800 00000020:00000080:2.0:1787572548.310431:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787572548.310437:0:15082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572548.310440:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572548.310441:0:15082:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787572548.310444:0:15082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787572548.310446:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572548.310447:0:15082:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787572548.310450:0:15082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d0c52f5800 00000020:00000080:2.0:1787572548.310466:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787572548.310536:0:15082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572548.310540:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572548.310541:0:15082:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787572548.310544:0:15082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787572548.310547:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572548.310548:0:15082:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787572548.310551:0:15082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d0c52f5800 00000020:00000080:2.0:1787572548.310553:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787572548.310590:0:15082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787572548.310593:0:15082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787572548.310594:0:15082:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787572548.310597:0:15082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787572548.315121:0:15064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787572548.315181:0:15064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787572548.315202:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572548.315217:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787572548.315286:0:15064:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787572548.315290:0:15064:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d0c52f5800 10000000:01000000:0.0:1787572548.315293:0:15064:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d0c52f5800 10000000:01000000:0.0:1787572548.315298:0:15064:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787572548.315304:0:15064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d0c52f5800 from 1 10000000:01000000:0.0:1787572548.315306:0:15064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787572548.315347:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1f4670c00/0x9fe530ef4f43746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572548.315355:0:15064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1f4670c00/0x9fe530ef4f43746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572548.315366:0:15064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1f4670c00/0x9fe530ef4f43746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572548.315394:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787572548.315468:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572548.315507:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cebc4240 going to sleep for 11 seconds 00000100:00100000:1.0:1787572548.317079:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268488192 00000100:00100000:1.0:1787572548.317090:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268488192 00000100:00100000:1.0:1787572548.317149:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787572548.317160:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268488192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572548.317177:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572548.317195:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c1463000/0x9fe530ef4f437471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43746a expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.317223:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c1463000/0x9fe530ef4f437471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43746a expref: 16 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.317235:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c1463000/0x9fe530ef4f437471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43746a expref: 16 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.317254:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463000, rc 0) 00000100:00100000:1.0:1787572548.317324:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488192:12345-0@lo:101:mount.lustre.0 Request processed in 165us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572548.317344:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787572548.319179:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787572548.319208:0:15064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1f4670c00/0x9fe530ef4f43746a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437471 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572548.319229:0:15064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1f4670c00/0x9fe530ef4f43746a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437471 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787572548.320168:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787572548.320735:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787572548.322782:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787572548.322869:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787572548.323629:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787572548.323749:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787572548.323789:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787572548.323864:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787572548.325001:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787572548.325098:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787572548.327371:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787572548.327475:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787572548.327514:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787572548.327585:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787572548.327624:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787572548.330239:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787572548.330355:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787572548.330395:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787572548.330428:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787572548.330478:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787572548.330530:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787572548.330561:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787572548.330604:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787572548.330682:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787572548.330718:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787572548.330767:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787572548.331029:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787572548.331065:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787572548.331155:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787572548.331196:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787572548.331291:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787572548.331299:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787572548.331426:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572548.331497:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572548.331548:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cebc4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787572548.331583:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268488320 00000100:00100000:0.0:1787572548.331594:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268488320 00000100:00100000:0.0:1787572548.331677:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787572548.331688:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572548.333396:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488320:12345-0@lo:501:mount.lustre.0 Request processed in 1703us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.333409:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787572548.333477:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572548.334648:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787572548.334710:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572548.334756:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cebc4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787572548.335005:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268488448 00000100:00100000:3.0:1787572548.335013:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268488448 00000100:00100000:3.0:1787572548.335064:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787572548.335073:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787572548.336400:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488448:12345-0@lo:503:mount.lustre.0 Request processed in 1323us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572548.336411:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787572548.336792:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787572548.341135:0:15064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787572548.342389:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787572548.342470:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572548.342604:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268488576 00000100:00100000:0.0:1787572548.342613:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268488576 00000100:00100000:0.0:1787572548.342677:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787572548.342688:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787572548.342982:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488576:12345-0@lo:502:mount.lustre.0 Request processed in 295us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.342990:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787572548.343049:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1ce950180 going to sleep for 11 seconds 00000100:00100000:0.0:1787572548.343074:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787572548.343357:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787572548.343405:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787572548.343440:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787572548.343501:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787572548.343542:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787572548.343606:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787572548.343667:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787572548.343699:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787572548.343737:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787572548.343765:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787572548.343790:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787572548.343830:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787572548.343866:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787572548.343902:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787572548.343989:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787572548.344036:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787572548.344081:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787572548.344136:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787572548.344174:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787572548.344211:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787572548.344256:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787572548.344305:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787572548.344342:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787572548.344390:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787572548.344426:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787572548.344472:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787572548.344519:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787572548.344552:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787572548.344582:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787572548.348770:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787572548.349226:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787572548.349276:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787572548.349314:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787572548.349394:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787572548.349435:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787572548.350272:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787572548.350340:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787572548.350401:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787572548.350462:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787572548.351268:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787572548.351335:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787572548.351429:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572548.354812:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e75ce840 going to sleep for 11 seconds 00000100:00100000:2.0:1787572548.358599:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268488704 00000100:00100000:2.0:1787572548.358623:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268488704 00000100:00100000:2.0:1787572548.358820:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787572548.358833:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572548.361118:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488704:12345-0@lo:502:mount.lustre.0 Request processed in 2275us (9676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572548.361626:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787572548.363770:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787572548.364351:0:15064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787572548.364373:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787572548.367450:0:15087:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787572548.367475:0:15087:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98d0c50c19b8) 00000020:00000080:1.0:1787572548.367499:0:15087:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787572548.367579:0:15087:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d0c52f5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787572548.367584:0:15087:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d0c52f5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787572548.367586:0:15087:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d0c52f5800 3 00010000:00080000:1.0:1787572548.367618:0:15087:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d0c6273000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1787572548.369433:0:15087:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787572548.369658:0:15087:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787572548.369693:0:15087:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787572548.369704:0:15087:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9fe530ef4f43747f 00000100:00080000:1.0:1787572548.369716:0:15087:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787572548.369722:0:15087:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98d0c6273000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1787572548.369761:0:15087:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1f4529f80 x1874405268488832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787572548.369794:0:15087:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787572548.371811:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787572548.372014:0:15064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787572548.372161:0:15064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787572548.372186:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1f4670c00/0x9fe530ef4f43746a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437471 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572548.372198:0:15064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1f4670c00/0x9fe530ef4f43746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437471 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787572548.372254:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787572548.372256:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787572548.372258:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572548.372259:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572548.372260:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572548.372261:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572548.372263:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787572548.372265:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572548.372266:0:15064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787572548.372271:0:15064:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787572548.372273:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787572548.372275:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787572548.372276:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572548.372277:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572548.372278:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572548.372279:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572548.372280:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787572548.372282:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572548.372283:0:15064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787572548.372308:0:15064:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787572548.372329:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4528700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488960:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787572548.372404:0:15064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572548.372445:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d5de2480 going to sleep for 11 seconds 00000100:00080000:1.0:1787572548.372694:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787572548.372699:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787572548.372702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787572548.372705:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787572548.372761:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874405268488832:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787572548.372802:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572548.372844:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268489088:0@lo:400:kworker.0 00000100:00100000:1.0:1787572548.372994:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572548.373888:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268488832 00000100:00100000:0.0:1787572548.373898:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268488832 00000100:00100000:0.0:1787572548.373957:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268489088 00000100:00100000:0.0:1787572548.373961:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268489088 00000100:00100000:1.0:1787572548.373982:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787572548.373990:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874405268488832:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787572548.374117:0:14383:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:1.0:1787572548.374156:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9fe530ef4f437486 00000004:00100000:1.0:1787572548.374172:0:14383:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787572548.374208:0:14383:0:(import.c:65:import_set_state_nolock()) ffff98d0c6275800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787572548.374282:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874405268488832:12345-0@lo:38:llog_process_th.0 Request processed in 291us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.375004:0:14385:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787572548.375017:0:14385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787572548.375040:0:14384:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787572548.375055:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787572548.375064:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268489088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572548.376890:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268489088:12345-0@lo:400:kworker.0 Request processed in 1403us (3471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572548.376973:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572548.377319:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268488960 00000100:00100000:2.0:1787572548.377330:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268488960 00000100:00100000:2.0:1787572548.377440:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787572548.377449:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15064:x1874405268488960:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787572548.377478:0:14376:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787572548.377680:0:14376:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787572548.377883:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787572548.377955:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d1f4529f80 x1874405268488832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787572558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572548.377969:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787572548.377979:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787572548.377990:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787572548.377995:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787572548.377999:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d0c6273000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787572548.378007:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874405268488832:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787572548.380352:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d1f4529c00 x1874405268489088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572548.380382:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268489088:0@lo:400:kworker.0 20000000:01000000:2.0:1787572548.449228:0:14376:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787572548.449253:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787572548.449325:0:14399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787572548.449332:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787572548.449359:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.449380:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.449490:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.449540:0:14399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572548.449555:0:14399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 16 pid: 14376 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572548.449570:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874405268489216:0@lo:104: 00000100:00100000:3.0:1787572548.449656:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572548.449716:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c56c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787572548.449787:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268489216 00000100:00100000:2.0:1787572548.449796:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268489216 00000100:00100000:2.0:1787572548.449850:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572548.449878:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:14399:x1874405268489216:12345-0@lo:104: 00010000:00010000:2.0:1787572548.449893:0:14367:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.449961:0:14367:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787572548.449967:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:14399:x1874405268489216:12345-0@lo:104: Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572548.449974:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787572548.449996:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572548.450002:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450009:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eaa00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:2.0:1787572548.450013:0:14373:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450021:0:14373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787572548.450029:0:14373:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572548.450034:0:14373:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787572548.450065:0:14373:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450071:0:14373:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787572548.450092:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450110:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1de0eaa00/0x9fe530ef4f4373f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f4373fa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450201:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572548.450204:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572548.450206:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572548.450226:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268489344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787572548.450259:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572548.450307:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268489344 00000100:00100000:2.0:1787572548.450312:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268489344 00010000:00010000:2.0:1787572548.450331:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 17 pid: 14376 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572548.450353:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572548.450360:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc703100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:3311:x1874405268489344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572548.450371:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572548.450377:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 17 pid: 14376 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450908:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 17 pid: 14376 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450931:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450940:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787572548.450965:0:14371:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001831941s 00010000:00010000:2.0:1787572548.450979:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450986:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450993:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.450999:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.451004:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572548.451008:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.451015:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.451024:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.451035:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572548.451078:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc703100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:3311:x1874405268489344:12345-0@lo:103:ldlm_bl.0 Request processed in 718us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572548.451086:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572548.451661:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268489344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572548.451706:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1f4671800/0x9fe530ef4f4373fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f4373f3 expref: 16 pid: 14376 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572548.451720:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874405268489216:0@lo:104: 00010000:00010000:2.0:1787572548.451748:0:14399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.451758:0:14399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.451764:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572548.451769:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0eb000/0x9fe530ef4f43748d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572548.457558:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:15064:x1874405268488960:12345-0@lo:253:mount.lustre.0 Request processed in 80100us (85144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572548.457574:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787572548.457770:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4528700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15064:1874405268488960:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787572548.457787:0:15064:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787572548.457790:0:15064:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787572548.457808:0:15064:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787572548.457809:0:15064:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787572548.457810:0:15064:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787572548.457812:0:15064:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787572548.457813:0:15064:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787572548.457815:0:15064:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787572548.457816:0:15064:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787572548.457818:0:15064:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787572548.457838:0:15064:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787572548.462798:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787572548.463250:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787572548.463497:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787572548.463781:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787572548.463957:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787572548.464810:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787572548.465065:0:15064:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787572548.466288:0:15064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787572548.564914:0:15064:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787572548.564923:0:15064:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787572548.564977:0:15064:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787572548.565046:0:15064:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787572548.565064:0:15064:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787572548.565092:0:15064:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787572549.486781:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787572550.255959:0:14381:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787572550.255968:0:14381:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d1f4534000 from 7 10000000:01000000:2.0:1787572550.255974:0:14381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787572550.256036:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572550.256050:0:14381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572550.256064:0:14381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572550.256094:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268489472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787572550.256168:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572550.259024:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde47b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787572550.259335:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268489472 00000100:00100000:0.0:1787572550.259346:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268489472 00000100:00100000:0.0:1787572550.259423:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787572550.259434:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+15:14381:x1874405268489472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572550.259455:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572550.259478:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437494 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572550.259507:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 16 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572550.259534:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 16 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572550.259545:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671e00, rc 0) 00000100:00100000:0.0:1787572550.260432:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:14381:x1874405268489472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572550.260444:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787572550.260523:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268489472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572550.260548:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572550.260560:0:14381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572550.260924:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268489600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787572550.260970:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572550.261628:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e75ce000 going to sleep for 11 seconds 00000100:00100000:0.0:1787572550.261805:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268489600 00000100:00100000:0.0:1787572550.261814:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268489600 00000100:00100000:0.0:1787572550.261868:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787572550.261878:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:14381:x1874405268489600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787572550.261901:0:14376:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787572550.261932:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787572550.261935:0:14376:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787572550.262038:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:14381:x1874405268489600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572550.262046:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787572550.263157:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268489600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787572550.263236:0:14381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787572550.263245:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572550.263255:0:14381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572550.513671:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572551.535425:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572552.560285:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572553.583665:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787572553.710949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787572553.710957:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787572553.710960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787572553.710964:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787572553.712133:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39be3db9-5eba-42e2-9087-a4df3ec904cb:3312:1874405268489728:0@lo:400:kworker.0 00000100:00100000:1.0:1787572553.712206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572553.712259:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572553.712265:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268489856:0@lo:400:kworker.0 00000100:00100000:1.0:1787572553.712445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572553.712485:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268489728 00000100:00100000:1.0:1787572553.712493:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268489728 00000100:00100000:1.0:1787572553.712663:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787572553.712675:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3312:x1874405268489728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572553.712737:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3312:x1874405268489728:12345-0@lo:400:kworker.0 Request processed in 64us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572553.712745:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787572553.712778:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268489856 00000100:00100000:1.0:1787572553.712782:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268489856 00000100:00100000:1.0:1787572553.712809:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787572553.712815:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268489856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572553.712850:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268489984:0@lo:400:kworker.0 00000100:00100000:1.0:1787572553.712862:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268489856:12345-0@lo:400:kworker.0 Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572553.712868:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572553.712884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787572553.712908:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccf100 x1874405268489856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572553.712923:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268489856:0@lo:400:kworker.0 00000100:00100000:1.0:1787572553.712933:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39be3db9-5eba-42e2-9087-a4df3ec904cb:3312:1874405268489728:0@lo:400:kworker.0 00000100:00100000:2.0:1787572553.712938:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268489984 00000100:00100000:2.0:1787572553.712941:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268489984 00000100:00100000:2.0:1787572553.712973:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787572553.712980:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268489984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572553.713023:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268489984:12345-0@lo:400:kworker.0 Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572553.713029:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787572553.713073:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787572553.723132:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccea00 x1874405268489984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572553.723153:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268489984:0@lo:400:kworker.0 00010000:00010000:1.0:1787572554.607369:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572555.631864:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572556.656148:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787572556.839434:0:15433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1787572557.103273:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787572557.678926:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572558.712979:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787572558.831812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787572558.831820:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787572558.831834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787572558.831837:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787572558.831856:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268490112:0@lo:400:kworker.0 00000100:00100000:0.0:1787572558.831941:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572558.832011:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268490112 00000100:00100000:0.0:1787572558.832017:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268490112 00000100:00100000:0.0:1787572558.832063:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787572558.832072:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3311:x1874405268490112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572558.832140:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3311:x1874405268490112:12345-0@lo:400:kworker.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572558.832148:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787572558.832196:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268490112:0@lo:400:kworker.0 00000100:00100000:0.0:1787572558.832237:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268490240:0@lo:400:kworker.0 00000100:00100000:0.0:1787572558.832263:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572558.832293:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268490240 00000100:00100000:0.0:1787572558.832297:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268490240 00000100:00100000:0.0:1787572558.832333:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787572558.832342:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268490240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572558.832388:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268490240:12345-0@lo:400:kworker.0 Request processed in 48us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572558.832394:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787572558.832658:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268490368:0@lo:400:kworker.0 00000100:00100000:2.0:1787572558.832695:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787572558.834118:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccdc00 x1874405268490240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572558.834139:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268490240:0@lo:400:kworker.0 00000100:00100000:0.0:1787572558.835564:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268490368 00000100:00100000:0.0:1787572558.835578:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268490368 00000100:00100000:0.0:1787572558.835714:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787572558.835727:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268490368:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787572558.835734:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572558.835893:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268490368:12345-0@lo:400:kworker.0 Request processed in 169us (3197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572558.835902:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787572558.836001:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccd880 x1874405268490368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572558.836016:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268490368:0@lo:400:kworker.0 00010000:00010000:3.0:1787572559.728929:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572560.622770:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787572545/real 1787572545] req@ffff98d0c6249500 x1874405268486144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787572560 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572560.622818:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d0c6249500 x1874405268486144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787572560 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572560.622832:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787572545/real 1787572545] req@ffff98d0c624bb80 x1874405268486272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787572560 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572560.622845:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d0c624bb80 x1874405268486272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787572560 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787572560.622864:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1d16bf800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787572560.622891:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787572560.622895:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268486144:0@lo:8:kworker.0 00000100:00080000:3.0:1787572560.622900:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787572560.622924:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787572560.622927:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268486272:0@lo:8:kworker.0 00000100:00080000:0.0:1787572560.623056:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787572560.623059:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787572560.623062:0:37:0:(import.c:65:import_set_state_nolock()) ffff98d1d16bf800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787572560.623066:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:0.0:1787572560.623071:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787572560.623077:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98d1d16bf800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1787572560.623094:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c6ccf800 x1874405268490624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787572560.623109:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787572560.623112:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787572560.623113:0:37:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787572560.623115:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:0.0:1787572560.623118:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787572560.623120:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d1de1f6800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1787572560.623127:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c6ccdf80 x1874405268490752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787572560.623198:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572560.623211:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268491008:0@lo:400:kworker.0 00000100:00100000:3.0:1787572560.623276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572560.623332:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268490624:0@lo:8:kworker.0 00000100:00100000:3.0:1787572560.623358:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572560.623375:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268490752:0@lo:8:kworker.0 00000100:00100000:3.0:1787572560.623391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572560.623433:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268490624 00000100:00100000:3.0:1787572560.623441:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268490624 00000100:00100000:3.0:1787572560.623467:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268490752 00000100:00100000:3.0:1787572560.623470:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268490752 00000100:00100000:3.0:1787572560.623482:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572560.623489:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874405268490624:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787572560.623516:0:15067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1787572560.623545:0:15067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f4374a2 00002000:00100000:3.0:1787572560.623560:0:15067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98d1d0af9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787572560.623565:0:15067:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787572560.623567:0:15067:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787572560.623919:0:15067:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787572560.623941:0:15067:0:(import.c:65:import_set_state_nolock()) ffff98d1d0aff000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787572560.623993:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874405268490624:12345-0@lo:8:kworker.0 Request processed in 503us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572560.624000:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787572560.624015:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787572560.624027:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874405268490752:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787572560.624037:0:15067:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787572560.624058:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874405268490752:12345-0@lo:8:kworker.0 Request processed in 31us (666us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787572560.624062:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787572560.624093:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccf800 x1874405268490624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787572580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572560.624102:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787572560.624108:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787572560.624114:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787572560.624119:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787572560.624121:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1d16bf800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787572560.624132:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787572560.624136:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268490624:0@lo:8:kworker.0 00000100:00080000:3.0:1787572560.624145:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787572560.624147:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787572560.624150:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268490752:0@lo:8:kworker.0 00000004:00080000:3.0:1787572560.624169:0:14405:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787572560.624347:0:14405:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 490720710958ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787572560.624800:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268491008 00000100:00100000:0.0:1787572560.624808:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268491008 00000100:00100000:0.0:1787572560.624864:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787572560.624871:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268491008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572560.624921:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268491008:12345-0@lo:400:kworker.0 Request processed in 51us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572560.624936:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1787572560.624982:0:14406:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787572560.624998:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14406:1874405268491264:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787572560.625027:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572560.625043:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d8013900 going to sleep for 11 seconds 00000100:00100000:0.0:1787572560.625062:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268491136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572560.625082:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787572560.625105:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccd500 x1874405268491008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572560.625115:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268491008:0@lo:400:kworker.0 00000100:00100000:0.0:1787572560.625139:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268491264 00000100:00100000:0.0:1787572560.625142:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268491264 00000100:00100000:0.0:1787572560.625158:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787572560.625162:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14406:x1874405268491264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787572560.627143:0:15067:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787572560.627153:0:15067:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787572560.627159:0:15067:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:1.0:1787572560.628520:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268490496:0@lo:400:kworker.0 00000100:00100000:1.0:1787572560.628607:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572560.628688:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787572560.628696:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268490880:0@lo:400:kworker.0 00000100:00100000:1.0:1787572560.628732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572560.629194:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268491136 00000100:00100000:1.0:1787572560.629202:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268491136 00000100:00100000:1.0:1787572560.629247:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787572560.629255:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268491136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787572560.629290:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787572560.629335:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874405268491136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (4252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572560.629343:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787572560.629375:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6cce680 x1874405268491136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572560.629399:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268491136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787572560.629456:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268490496 00000100:00100000:1.0:1787572560.629461:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268490496 00000100:00100000:1.0:1787572560.629499:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787572560.629506:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3310:x1874405268490496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572560.629543:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3310:x1874405268490496:12345-0@lo:400:kworker.0 Request processed in 38us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572560.629550:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787572560.629576:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268490880 00000100:00100000:1.0:1787572560.629579:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268490880 00000100:00100000:1.0:1787572560.629605:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787572560.629610:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268490880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572560.629653:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268490880:12345-0@lo:400:kworker.0 Request processed in 43us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572560.629658:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787572560.629684:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccce00 x1874405268490880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787572560.629694:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268490880:0@lo:400:kworker.0 00000100:00100000:1.0:1787572560.629702:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268490496:0@lo:400:kworker.0 00000100:00080000:3.0:1787572560.630615:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787572560.630623:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:0.0:1787572560.640654:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.640672:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.640695:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.640700:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.640715:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.640745:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.640756:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.640765:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.640786:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572560.641702:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.641722:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.641733:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.641745:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.641756:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.641778:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.641786:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f4374a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.641813:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.641816:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.641818:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.642094:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.642100:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.642112:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.642116:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.642123:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.642133:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.642143:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.642253:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.642292:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787572560.643319:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.643327:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.643339:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.643342:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.643346:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.643356:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.643364:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.643371:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643472:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787572560.643479:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643488:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.643493:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643503:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643520:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643536:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f4374b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643555:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.643558:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643565:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.643568:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643574:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643584:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.643592:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.643594:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.643596:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.643804:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787572560.643809:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f4374b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.644610:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.646067:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.646080:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.646097:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.646101:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.646108:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.646120:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.646129:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.646136:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.647650:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572560.648461:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.648473:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.648486:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.648498:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.648509:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.648529:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.648536:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f4374be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.648558:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.648560:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.648562:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.650078:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.650090:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.650105:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.650109:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.650120:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.650133:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.650141:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.650146:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.650873:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572560.651628:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.651651:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.651662:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.651667:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.651677:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.651697:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.651723:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f4374c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.651743:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.651745:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.651747:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.652356:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.652366:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.652380:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.652386:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.652394:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.652406:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.652414:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.652433:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.652520:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572560.652557:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.652564:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.652573:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670e00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.652577:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.652585:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.652600:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.652608:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f4374cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.652623:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.652625:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.652627:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.652996:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.653003:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.653012:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.653015:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.653020:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.653030:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.653038:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.653045:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.653068:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787572560.653320:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572560.653326:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.653334:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572560.653343:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.653352:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.653366:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.653373:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f4374d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.653388:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.653389:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.653391:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.654693:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.654716:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.654732:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.654736:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.654742:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.654755:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.654764:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.654772:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.654796:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572560.654834:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572560.654839:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.654853:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eac00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572560.654857:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.654865:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.654879:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.654885:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b19f1e2d/0x9fe530ef4f4374da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.654899:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.654901:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.654902:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.655198:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.655204:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655212:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.655214:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.655218:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655237:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655245:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655251:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655272:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787572560.655399:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572560.655405:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.655423:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572560.655428:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.655436:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.655448:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.655462:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d5acb01/0x9fe530ef4f4374e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.655475:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.655477:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.655479:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.655782:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.655788:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655797:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.655800:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.655804:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655813:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655821:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655839:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.655858:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572560.655980:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572560.655985:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.655993:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572560.655996:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.656004:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.656022:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.656029:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82675d2/0x9fe530ef4f4374e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.656041:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.656043:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.656045:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.656232:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.656238:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656247:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.656250:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.656254:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656263:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656271:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656278:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656298:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787572560.656324:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572560.656329:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.656337:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572560.656341:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.656349:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.656360:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.656367:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb81efe/0x9fe530ef4f4374ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.656379:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.656381:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.656383:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.656817:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.656823:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656837:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.656840:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.656845:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656855:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656863:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656870:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.656883:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787572560.657031:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572560.657039:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.657047:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572560.657051:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.657059:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.657073:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.657080:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b233f2d4/0x9fe530ef4f4374f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.657094:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572560.657096:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572560.657098:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.657267:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.657274:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657282:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.657284:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.657288:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657297:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657316:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657323:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657341:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787572560.657371:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572560.657376:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.657383:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572560.657387:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.657395:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.657406:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.657424:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000061a34a9/0x9fe530ef4f4374fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.657438:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.657440:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.657441:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.657854:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.657860:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657868:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.657871:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.657876:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657885:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657892:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657899:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.657924:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572560.658063:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572560.658069:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.658077:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eaa00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572560.658081:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.658088:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.658100:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.658108:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006440323f/0x9fe530ef4f437504 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.658132:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.658134:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.658135:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.658302:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.658307:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658315:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.658318:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.658322:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658332:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658339:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658346:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658361:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787572560.658367:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572560.658372:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.658380:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572560.658383:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.658400:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.658411:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.658493:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087aed4d0/0x9fe530ef4f43750b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.658508:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.658510:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.658512:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.658846:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.658851:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658859:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.658868:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.658873:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658882:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658890:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658897:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.658913:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572560.659005:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572560.659010:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659018:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eba00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572560.659022:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659030:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659042:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659050:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a92e0727/0x9fe530ef4f437512 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659062:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.659063:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.659065:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572560.659285:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572560.659291:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.659299:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1787572560.659302:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572560.659306:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.659317:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.659325:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.659339:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.659361:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572560.659385:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572560.659389:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659406:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572560.659410:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659496:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659509:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659516:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10a142b/0x9fe530ef4f437519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659530:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.659531:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.659533:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.659893:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.659899:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659908:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.659911:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.659915:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659924:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659939:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659947:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.659970:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787572560.660623:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.660629:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.660660:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.660663:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.660667:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.660677:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.660686:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.660694:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.660734:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787572560.660739:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787572560.660741:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.660745:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.660753:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.660756:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.660765:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.660778:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.660785:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a5892fb/0x9fe530ef4f437520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.660800:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.660802:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.660803:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.661130:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.661136:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.661144:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.661147:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.661151:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.661160:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.661168:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.661175:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.661195:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787572560.661225:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572560.661231:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.661238:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670a00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572560.661242:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.661250:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.661261:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.661279:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055272bcb/0x9fe530ef4f43752e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.661292:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.661294:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572560.661296:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787572560.661697:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787572560.662077:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.662085:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.662087:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.662123:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787572560.662124:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662128:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662134:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572560.662138:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662138:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.662146:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.662152:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662162:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662164:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662171:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662177:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662178:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662185:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000968994be/0x9fe530ef4f437527 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662198:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572560.662198:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787572560.662201:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662207:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572560.662210:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662218:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662227:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662234:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d90cbeab/0x9fe530ef4f437535 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.662254:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572560.662255:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572560.662257:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.662339:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.662748:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.662754:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662763:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.662767:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.662771:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662780:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662789:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662802:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.662821:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572560.662837:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.662842:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.662850:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670e00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.662853:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.662860:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.662872:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.662879:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43753c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.662892:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.662893:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.662895:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.663200:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.663207:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663215:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.663218:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.663222:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663231:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663240:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663247:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663265:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787572560.663500:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572560.663506:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.663514:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572560.663518:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.663527:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.663538:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.663545:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61edbc6/0x9fe530ef4f437543 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572560.663558:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572560.663559:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572560.663561:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.663746:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.663752:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663766:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.663770:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.663774:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663784:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663792:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663800:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.663817:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787572560.664164:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.664170:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664177:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.664179:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.664183:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664191:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664210:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664217:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664238:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787572560.664774:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.664780:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664789:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.664793:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.664797:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664806:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664814:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.664822:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665621:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787572560.665630:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665656:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.665671:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665681:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665697:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665704:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3dec2c3/0x9fe530ef4f43754a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665926:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787572560.665930:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665937:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.665941:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665949:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665960:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665967:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e771376/0x9fe530ef4f437551 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665984:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.665988:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.665994:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.665997:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.666005:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.666013:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.666020:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.666021:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.666023:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.666110:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787572560.666116:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003af1b60f/0x9fe530ef4f437558 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572560.666614:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572560.667273:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787572560.667738:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.667748:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.667764:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.667768:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.667774:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.667787:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.667797:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.667805:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.667870:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787572560.669612:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787572560.669623:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.669671:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787572560.669674:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572560.669680:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.669692:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.669700:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572560.669717:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.669942:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787572560.669950:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.669959:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.669963:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.669984:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.670002:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.670010:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dfe1b8d/0x9fe530ef4f43755f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.670028:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572560.670031:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.670037:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31c00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572560.670041:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.670048:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.670057:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572560.670063:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.670065:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572560.670072:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572560.670137:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787572560.670142:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b55f908/0x9fe530ef4f437566 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787572560.670395:0:15067:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1787572560.670517:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14406:x1874405268491264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 45350us (45484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572560.670526:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787572560.670716:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14406:1874405268491264:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787572560.670734:0:14406:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787572560.670790:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14406:1874405268491392:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787572560.670831:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572560.670873:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572560.671050:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268491392 00000100:00100000:3.0:1787572560.671058:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268491392 00000100:00100000:3.0:1787572560.671098:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787572560.671107:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14406:x1874405268491392:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787572560.671144:0:15066:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1787572560.671776:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572560.676582:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14406:x1874405268491392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5469us (5744us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787572560.676595:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572560.676786:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14406:1874405268491392:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787572560.676801:0:14406:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1787572560.751560:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572561.780523:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572562.799212:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572563.822874:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787572564.078057:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787572564.078084:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787572564.847966:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787572565.849013:0:15788:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787572565.849018:0:15788:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787572565.849181:0:15788:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d0c6271000 00000020:01000004:1.0:1787572565.849198:0:15788:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787572565.849211:0:15788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787572565.849226:0:15788:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98d0c50c0000) 00000020:00000080:1.0:1787572565.849243:0:15788:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1787572565.874880:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787572565.920033:0:15788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787572565.921819:0:15788:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787572565.924065:0:15788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787572565.924303:0:15788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787572565.924516:0:15788:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787572565.931659:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 149: rc = 0 00100000:10000000:3.0:1787572565.931810:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 149: rc = 0 00100000:10000000:3.0:1787572565.931913:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 149: rc = 0 00100000:10000000:3.0:1787572565.934790:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 569: rc = 0 00100000:10000000:3.0:1787572565.935128:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 569: rc = 0 00100000:10000000:3.0:1787572565.935428:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 569: rc = 0 00100000:10000000:3.0:1787572565.935726:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 569: rc = 0 00100000:10000000:3.0:1787572565.935976:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 569: rc = 0 00100000:10000000:3.0:1787572565.941590:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 569: rc = 0 00000020:00000080:3.0:1787572565.942244:0:15788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787572565.942258:0:15788:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787572565.942271:0:15788:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9fe530ef4f437574 00000020:01000004:3.0:1787572565.942287:0:15788:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787572565.942313:0:15788:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.155@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787572565.942317:0:15788:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787572565.942323:0:15788:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787572565.942346:0:15788:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787572565.942350:0:15788:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787572565.978271:0:15788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787572565.978321:0:15788:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.155@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787572565.978326:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787572565.978327:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787572565.978328:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572565.978329:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572565.978331:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572565.978332:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572565.978333:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572565.978335:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572565.978337:0:15788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787572565.978341:0:15788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787572565.978343:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787572565.978344:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787572565.978345:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787572565.978346:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787572565.978347:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787572565.978348:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787572565.978350:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787572565.978351:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787572565.978352:0:15788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787572565.978380:0:15788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787572565.978399:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc700e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268491520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787572565.978479:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572565.987686:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268491520 00000100:00100000:1.0:1787572565.987702:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268491520 00000100:00100000:1.0:1787572565.987770:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787572565.987782:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15788:x1874405268491520:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787572565.987819:0:14379:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787572565.987823:0:14379:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787572565.987826:0:14379:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787572565.989448:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787572566.000883:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787572566.000910:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268491648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572566.000985:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572566.001041:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268491648 00000100:00100000:2.0:1787572566.001048:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268491648 00000100:00100000:2.0:1787572566.001112:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787572566.001122:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268491648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572566.001156:0:15070:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572566.001203:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268491648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.001210:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787572566.001231:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572566.001254:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787572566.001277:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268491648:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787572566.005482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787572566.005492:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787572566.005496:0:8:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787572566.005506:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:0.0:1787572566.005513:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787572566.005523:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d1de1f6800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1787572566.005570:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d0c6ccd500 x1874405268491776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787572566.005810:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787572566.005828:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268491904:0@lo:400:kworker.0 00000100:00100000:0.0:1787572566.005894:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572566.005946:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268491904 00000100:00100000:0.0:1787572566.005954:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268491904 00000100:00100000:0.0:1787572566.006002:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787572566.006011:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268491904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572566.006062:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874405268491904:12345-0@lo:400:kworker.0 Request processed in 52us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572566.006069:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787572566.006109:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccc380 x1874405268491904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572566.006125:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874405268491904:0@lo:400:kworker.0 00000100:00100000:2.0:1787572566.006844:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268492032:0@lo:400:kworker.0 00000100:00100000:2.0:1787572566.006883:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572566.006984:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268492032 00000100:00100000:0.0:1787572566.006989:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268492032 00000100:00100000:0.0:1787572566.007041:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787572566.007049:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268492032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572566.007107:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268492032:12345-0@lo:400:kworker.0 Request processed in 58us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572566.007114:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787572566.011400:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787572566.011473:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d0c6ccd180 x1874405268492032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572566.011492:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268492032:0@lo:400:kworker.0 00000100:00100000:3.0:1787572566.011785:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268491776:0@lo:8:kworker.0 00000100:00100000:3.0:1787572566.011854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572566.012016:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268491776 00000100:00100000:0.0:1787572566.012024:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268491776 00000100:00100000:0.0:1787572566.012070:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787572566.012078:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874405268491776:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787572566.012099:0:15067:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787572566.017611:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15788:x1874405268491520:12345-0@lo:253:mount.lustre.0 Request processed in 29807us (39107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.017627:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787572566.018115:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc700e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268491520:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787572566.018514:0:15788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787572566.018534:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787572566.018536:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787572566.018538:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787572566.018539:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787572566.018541:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787572566.018542:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787572566.018544:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787572566.018546:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787572566.018547:0:15788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787572566.018624:0:15788:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d0c6271000 from lustre-OST0001 10000000:01000000:3.0:1787572566.018703:0:15788:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787572566.018707:0:15788:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787572566.018726:0:15788:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98d1d5ed0000 local copy 00010000:00010000:3.0:1787572566.018737:0:15788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572566.019123:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787572566.019560:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572566.020408:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572566.027819:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268492160 00000100:00100000:2.0:1787572566.027899:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268492160 00000100:00100000:2.0:1787572566.028102:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787572566.028113:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15788:x1874405268492160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787572566.028454:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15788:x1874405268492160:12345-0@lo:501:mount.lustre.0 Request processed in 341us (8892us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787572566.028462:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787572566.028558:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492160:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787572566.028598:0:15788:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787572566.028796:0:15788:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787572566.028806:0:15788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.028831:0:15788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c0031400/0x9fe530ef4f43731a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437321 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572566.028865:0:15788:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d0c6271000 10000000:01000000:1.0:1787572566.028871:0:15788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787572566.028877:0:15788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787572566.028879:0:15788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787572566.028884:0:15788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787572566.028887:0:15788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787572566.028921:0:15788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f43757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.028929:0:15788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f43757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.028939:0:15788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f43757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572566.028960:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572566.028999:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572566.039102:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1b5f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787572566.047461:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268492288 00000100:00100000:3.0:1787572566.047478:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268492288 00000100:00100000:3.0:1787572566.047573:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787572566.047584:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:15788:x1874405268492288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787572566.047612:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572566.047652:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f437582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f43757b expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572566.047684:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f437582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f43757b expref: 17 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572566.047696:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1de0ea800/0x9fe530ef4f437582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43757b expref: 17 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572566.047705:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea800, rc 0) 00000100:00100000:3.0:1787572566.047788:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492288:12345-0@lo:101:mount.lustre.0 Request processed in 206us (18787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572566.047796:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787572566.048199:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572566.048220:0:15788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f43757b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437582 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.048229:0:15788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f43757b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437582 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787572566.049019:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787572566.049889:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787572566.050124:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787572566.050168:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787572566.050204:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787572566.050250:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787572566.050287:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787572566.050321:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787572566.050387:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787572566.050394:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787572566.050502:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572566.050565:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572566.050654:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1b5f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572566.050873:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268492416 00000100:00100000:2.0:1787572566.050893:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268492416 00000100:00100000:2.0:1787572566.050965:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787572566.050976:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787572566.051396:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492416:12345-0@lo:501:mount.lustre.0 Request processed in 422us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.051404:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787572566.060701:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787572566.060714:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787572566.060720:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268491776:0@lo:8:kworker.0 00000100:00100000:0.0:1787572566.064491:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874405268491776:12345-0@lo:8:kworker.0 Request processed in 48507us (48730us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787572566.064508:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787572566.064685:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4529500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572566.064835:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492544:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787572566.064912:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572566.064956:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cebc4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572566.065911:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268492544 00000100:00100000:2.0:1787572566.065920:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268492544 00000100:00100000:2.0:1787572566.065979:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787572566.065989:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787572566.066583:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492544:12345-0@lo:503:mount.lustre.0 Request processed in 595us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.066592:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787572566.070758:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492544:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787572566.071907:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787572566.072012:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572566.072466:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572566.072521:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787572566.072610:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268492672 00000100:00100000:0.0:1787572566.072619:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268492672 00000100:00100000:0.0:1787572566.072675:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787572566.072684:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572566.078534:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492672:12345-0@lo:502:mount.lustre.0 Request processed in 5838us (6056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.078549:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787572566.080523:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787572566.081007:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787572566.081086:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787572566.081120:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787572566.081182:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787572566.081222:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787572566.081259:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787572566.081307:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787572566.081346:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787572566.081414:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787572566.081461:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787572566.081551:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572566.081599:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787572566.082573:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268492800 00000100:00100000:2.0:1787572566.082585:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268492800 00000100:00100000:2.0:1787572566.082684:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787572566.082696:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572566.083135:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492800:12345-0@lo:502:mount.lustre.0 Request processed in 440us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.083144:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787572566.083513:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787572566.083666:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787572566.083680:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787572566.085727:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787572566.085737:0:15789:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787572566.085744:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787572566.085746:0:15789:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787572566.085752:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787572566.085784:0:15789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98d1f3c6b370) 00000020:00000080:0.0:1787572566.085809:0:15789:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787572566.085816:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787572566.085877:0:15789:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d0c6271000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787572566.085883:0:15789:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787572566.085889:0:15789:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9fe530ef4f437590 00010000:00010000:0.0:1787572566.097485:0:15789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787572566.099852:0:15789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787572566.103244:0:15789:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787572566.109855:0:15789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787572566.109868:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572566.109874:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.109876:0:15789:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787572566.109879:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572566.109884:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.109885:0:15789:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787572566.109888:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787572566.109890:0:15789:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787572566.109892:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572566.109894:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.109896:0:15789:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787572566.109898:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572566.109900:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.109901:0:15789:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787572566.109904:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787572566.109960:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572566.109962:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.109963:0:15789:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787572566.109966:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787572566.110118:0:15788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787572566.110156:0:15788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787572566.110178:0:15788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f43757b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437582 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.110189:0:15788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1462400/0x9fe530ef4f43757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437582 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572566.110198:0:15788:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d0c6271000 from 1 10000000:01000000:1.0:1787572566.110200:0:15788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787572566.110239:0:15788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.110247:0:15788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.110274:0:15788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572566.110298:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787572566.110470:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572566.110702:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b24480 going to sleep for 11 seconds 00000100:00100000:3.0:1787572566.114798:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268492928 00000100:00100000:3.0:1787572566.114814:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268492928 00000100:00100000:3.0:1787572566.114934:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787572566.114946:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:15788:x1874405268492928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787572566.114978:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572566.114997:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437597 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572566.115027:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572566.115039:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572566.115049:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eae00, rc 0) 00000100:00100000:3.0:1787572566.115137:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268492928:12345-0@lo:101:mount.lustre.0 Request processed in 193us (4771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572566.115144:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787572566.117178:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268492928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572566.117206:0:15788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.117219:0:15788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787572566.117802:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787572566.118101:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787572566.118310:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787572566.118352:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787572566.118413:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787572566.118421:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787572566.118487:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572566.118553:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572566.118989:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b24480 going to sleep for 11 seconds 00000100:00100000:2.0:1787572566.121670:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268493056 00000100:00100000:2.0:1787572566.121687:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268493056 00000100:00100000:2.0:1787572566.121758:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787572566.121770:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787572566.122128:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493056:12345-0@lo:501:mount.lustre.0 Request processed in 359us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.122137:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787572566.122295:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787572566.122374:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787572566.122423:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572566.122459:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b24480 going to sleep for 11 seconds 00000100:00100000:2.0:1787572566.122835:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268493184 00000100:00100000:2.0:1787572566.122840:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268493184 00000100:00100000:2.0:1787572566.122878:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787572566.122885:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787572566.123175:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493184:12345-0@lo:503:mount.lustre.0 Request processed in 289us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.123182:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787572566.123225:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787572566.124156:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787572566.124249:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572566.124300:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572566.124657:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572566.124775:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268493312 00000100:00100000:3.0:1787572566.124782:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268493312 00000100:00100000:1.0:1787572566.124860:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787572566.124870:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787572566.125097:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493312:12345-0@lo:502:mount.lustre.0 Request processed in 228us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572566.125106:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787572566.125198:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787572566.125833:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787572566.125900:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787572566.125945:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787572566.125981:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787572566.126015:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787572566.126064:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787572566.126101:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787572566.126137:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787572566.126172:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787572566.126226:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572566.129341:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572566.129723:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268493440 00000100:00100000:3.0:1787572566.129732:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268493440 00000100:00100000:3.0:1787572566.129777:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787572566.129786:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787572566.130027:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493440:12345-0@lo:502:mount.lustre.0 Request processed in 241us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572566.130035:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787572566.130150:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc702680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787572566.130320:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787572566.130344:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787572566.134802:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572566.134816:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.134818:0:15793:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787572566.134825:0:15793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d0c6271000 00000020:00000080:3.0:1787572566.134828:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787572566.134836:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572566.134850:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.134851:0:15793:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787572566.134855:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572566.134857:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.134858:0:15793:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787572566.134861:0:15793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d0c6271000 00000020:00000080:3.0:1787572566.134863:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787572566.134926:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572566.134930:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.134931:0:15793:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787572566.134933:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787572566.134935:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.134937:0:15793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787572566.134941:0:15793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d0c6271000 00000020:00000080:3.0:1787572566.134943:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787572566.134980:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787572566.134983:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787572566.134984:0:15793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787572566.134987:0:15793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787572566.135175:0:15788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787572566.135206:0:15788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787572566.135267:0:15788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572566.135279:0:15788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572566.135344:0:15788:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787572566.135347:0:15788:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d0c6271000 10000000:01000000:2.0:1787572566.135351:0:15788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d0c6271000 10000000:01000000:2.0:1787572566.135355:0:15788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787572566.135852:0:15788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d0c6271000 from 1 10000000:01000000:2.0:1787572566.135856:0:15788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787572566.135890:0:15788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f4375a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572566.135908:0:15788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f4375a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572566.135921:0:15788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f4375a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572566.135945:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc700e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787572566.136015:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572566.136051:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2f6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787572566.137305:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268493568 00000100:00100000:1.0:1787572566.137316:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268493568 00000100:00100000:1.0:1787572566.137374:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787572566.137384:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268493568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787572566.137401:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572566.137417:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1c1463400/0x9fe530ef4f4375ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4375a5 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.137442:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1c1463400/0x9fe530ef4f4375ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4375a5 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.137451:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1c1463400/0x9fe530ef4f4375ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4375a5 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.137459:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1463400, rc 0) 00000100:00100000:1.0:1787572566.137519:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268493568:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572566.137527:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787572566.139900:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc700e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787572566.139930:0:15788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f4375a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4375ac expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572566.139944:0:15788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f4375a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4375ac expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787572566.144525:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787572566.150179:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787572566.152170:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787572566.152237:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787572566.153346:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787572566.153547:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787572566.153692:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787572566.153738:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787572566.153766:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787572566.153792:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787572566.153829:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787572566.153858:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787572566.153895:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787572566.153948:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787572566.153977:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787572566.154002:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787572566.154038:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787572566.155682:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787572566.155737:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787572566.155804:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787572566.155842:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787572566.155871:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787572566.155912:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787572566.155942:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787572566.155969:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787572566.156008:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787572566.156042:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787572566.156073:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787572566.156133:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787572566.156183:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787572566.156215:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787572566.156264:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787572566.156296:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787572566.156329:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787572566.156364:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787572566.156416:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787572566.156454:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787572566.156505:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787572566.156543:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787572566.156684:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787572566.156693:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787572566.159156:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572566.159232:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572566.159285:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1b5f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787572566.161701:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268493696 00000100:00100000:0.0:1787572566.161717:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268493696 00000100:00100000:0.0:1787572566.161786:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787572566.161806:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268493696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572566.162128:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268493696:12345-0@lo:501:mount.lustre.0 Request processed in 333us (2895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572566.162135:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787572566.162192:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787572566.162240:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787572566.162281:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572566.163412:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268493824 00000100:00100000:0.0:1787572566.163420:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268493824 00000100:00100000:0.0:1787572566.163458:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787572566.163468:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268493824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787572566.164790:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268493824:12345-0@lo:503:mount.lustre.0 Request processed in 1319us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572566.164802:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787572566.164873:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1d1b5f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787572566.164896:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787572566.168275:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787572566.168793:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787572566.168890:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572566.168941:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde47900 going to sleep for 11 seconds 00000100:00100000:0.0:1787572566.169186:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268493952 00000100:00100000:0.0:1787572566.169196:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268493952 00000100:00100000:0.0:1787572566.169251:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787572566.169262:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268493952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787572566.170546:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268493952:12345-0@lo:502:mount.lustre.0 Request processed in 1281us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572566.171171:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787572566.173786:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268493952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787572566.175200:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787572566.175274:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787572566.175534:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787572566.175734:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787572566.175776:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787572566.175822:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787572566.175853:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787572566.175881:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787572566.175928:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787572566.175959:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787572566.175993:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787572566.176042:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787572566.178774:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787572566.178809:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787572566.178875:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787572566.178908:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787572566.178938:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787572566.178978:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787572566.179011:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787572566.179041:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787572566.179105:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787572566.179141:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787572566.179177:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787572566.179225:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787572566.179261:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787572566.179291:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787572566.179333:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787572566.179371:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787572566.179407:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787572566.179456:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787572566.179492:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787572566.179524:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787572566.179588:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787572566.182492:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787572566.182668:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787572566.182719:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787572566.182750:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787572566.182782:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787572566.182826:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787572566.182864:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787572566.182920:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268494080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787572566.183013:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572566.184225:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde47900 going to sleep for 11 seconds 00000100:00100000:0.0:1787572566.184382:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268494080 00000100:00100000:0.0:1787572566.184393:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268494080 00000100:00100000:0.0:1787572566.184457:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787572566.184468:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268494080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787572566.184864:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268494080:12345-0@lo:502:mount.lustre.0 Request processed in 397us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572566.184872:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787572566.185083:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268494080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787572566.185191:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787572566.185205:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787572566.190720:0:15798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787572566.190740:0:15798:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98d1de1cb370) 00000020:00000080:2.0:1787572566.190766:0:15798:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787572566.190859:0:15798:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d0c6271000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787572566.190864:0:15798:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d0c6271000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787572566.190867:0:15798:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d0c6271000 3 00010000:00080000:2.0:1787572566.190907:0:15798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d0c7363800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.155@tcp at head 00010000:00010000:2.0:1787572566.192522:0:15798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787572566.192781:0:15798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787572566.192820:0:15798:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787572566.192835:0:15798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9fe530ef4f4375ba 00000100:00080000:2.0:1787572566.192848:0:15798:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787572566.192854:0:15798:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98d0c7363800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1787572566.192899:0:15798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1fc701c00 x1874405268494208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787572566.192921:0:15798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787572566.193415:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874405268494208:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787572566.193504:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572566.193996:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268494208 00000100:00100000:2.0:1787572566.194005:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268494208 00000100:00100000:2.0:1787572566.194057:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787572566.194065:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874405268494208:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787572566.194092:0:14384:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:2.0:1787572566.194123:0:14384:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9fe530ef4f4375c1 00000004:00100000:2.0:1787572566.194137:0:14384:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787572566.194168:0:14384:0:(import.c:65:import_set_state_nolock()) ffff98d0c7367000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572566.194226:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874405268494208:12345-0@lo:38:llog_process_th.0 Request processed in 160us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.194232:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787572566.194270:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d1fc701c00 x1874405268494208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787572576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787572566.194703:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787572566.194712:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787572566.194719:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787572566.194723:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787572566.194726:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d0c7363800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787572566.194732:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874405268494208:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787572566.196528:0:15798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787572566.201766:0:15788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787572566.202142:0:15788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787572566.202197:0:15788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f4375a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4375ac expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572566.202210:0:15788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1fc277200/0x9fe530ef4f4375a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4375ac expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787572566.202272:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787572566.202274:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787572566.202275:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787572566.202276:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787572566.202278:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787572566.202279:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787572566.202281:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787572566.202283:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787572566.202284:0:15788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787572566.202288:0:15788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787572566.202290:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787572566.202291:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787572566.202302:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787572566.202303:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787572566.202304:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787572566.202305:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787572566.202307:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787572566.202308:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787572566.202309:0:15788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787572566.202337:0:15788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787572566.202358:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268494336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787572566.202433:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572566.202485:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787572566.203167:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268494336 00000100:00100000:1.0:1787572566.203177:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268494336 00000100:00100000:1.0:1787572566.203229:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787572566.203238:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:15788:x1874405268494336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787572566.203271:0:14379:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787572566.203288:0:14379:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787572566.367196:0:14379:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787572566.367271:0:14379:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787572566.369445:0:14399:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787572566.369455:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787572566.369482:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572566.369502:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572566.369512:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572566.369586:0:14399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572566.369609:0:14399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 19 pid: 14378 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572566.369624:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874405268494464:0@lo:104: 00000100:00100000:2.0:1787572566.369717:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572566.369770:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c2d86000 going to sleep for 11 seconds 00000100:00100000:1.0:1787572566.369917:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268494464 00000100:00100000:1.0:1787572566.369927:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268494464 00000100:00100000:1.0:1787572566.369977:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572566.369988:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:14399:x1874405268494464:12345-0@lo:104: 00010000:00010000:1.0:1787572566.370000:0:14368:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370069:0:14368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787572566.370075:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:14399:x1874405268494464:12345-0@lo:104: Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572566.370082:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787572566.370110:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572566.370116:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370123:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276c00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572566.370127:0:14372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370135:0:14372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572566.370142:0:14372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572566.370148:0:14372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787572566.370178:0:14372:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370185:0:14372:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572566.370204:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370211:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1fc276c00/0x9fe530ef4f437494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43749b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370228:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572566.370229:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572566.370231:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572566.370251:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39be3db9-5eba-42e2-9087-a4df3ec904cb:3313:1874405268494592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572566.370282:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572566.370325:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268494592 00000100:00100000:1.0:1787572566.370330:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268494592 00010000:00010000:1.0:1787572566.370346:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 20 pid: 14378 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572566.370368:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572566.370375:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+20:3313:x1874405268494592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572566.370385:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572566.370389:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 20 pid: 14378 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370399:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 20 pid: 14378 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370415:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370423:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787572566.370434:0:14371:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001831941s 00010000:00010000:1.0:1787572566.370439:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370446:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370452:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370459:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370475:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572566.370480:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370487:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370497:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.370506:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572566.370535:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+20:3313:x1874405268494592:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572566.370542:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787572566.370944:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39be3db9-5eba-42e2-9087-a4df3ec904cb:3313:1874405268494592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787572566.370976:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f43749b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f437494 expref: 19 pid: 14378 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572566.370987:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14399:1874405268494464:0@lo:104: 00010000:00010000:1.0:1787572566.370999:0:14399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.371007:0:14399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.371013:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572566.371029:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1fc276800/0x9fe530ef4f4375c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572566.501312:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:15788:x1874405268494336:12345-0@lo:253:mount.lustre.0 Request processed in 298061us (298866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572566.501330:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787572566.504883:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39be3db9-5eba-42e2-9087-a4df3ec904cb:15788:1874405268494336:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787572566.504904:0:15788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787572566.504908:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787572566.504910:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787572566.504911:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787572566.504913:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787572566.504915:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787572566.504916:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787572566.504918:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787572566.504920:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787572566.504921:0:15788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787572566.504938:0:15788:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787572566.516659:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572566.516850:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572566.517022:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572566.518843:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787572566.519101:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787572566.519314:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787572566.521908:0:15788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787572566.669160:0:15788:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787572566.669170:0:15788:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787572566.669205:0:15788:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787572566.669263:0:15788:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787572566.669279:0:15788:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787572566.669321:0:15788:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787572566.896095:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787572567.344307:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787572567.918803:0:14381:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787572567.918811:0:14381:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d1f4534000 from 8 10000000:01000000:1.0:1787572567.918816:0:14381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787572567.918864:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f4375cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572567.918877:0:14381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f4375cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572567.918890:0:14381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f4375cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572567.918917:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268494720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787572567.918991:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572567.919141:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1ead3c480 going to sleep for 11 seconds 00010000:00010000:3.0:1787572567.920425:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572567.927149:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268494720 00000100:00100000:0.0:1787572567.927164:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268494720 00000100:00100000:0.0:1787572567.927221:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787572567.927233:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:14381:x1874405268494720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572567.927251:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572567.927451:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1d0a30600/0x9fe530ef4f4375d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f4375cf expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572567.927481:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1d0a30600/0x9fe530ef4f4375d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f4375cf expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572567.927492:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1d0a30600/0x9fe530ef4f4375d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f4375cf expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572567.927501:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30600, rc 0) 00000100:00100000:0.0:1787572567.927600:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:14381:x1874405268494720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 369us (8609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572567.927619:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787572567.927808:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268494720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572567.927828:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f4375cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4375d6 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572567.927838:0:14381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f4375cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f4375d6 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572567.927907:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268494848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787572567.927952:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572567.927990:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787572567.928107:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268494848 00000100:00100000:0.0:1787572567.928112:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268494848 00000100:00100000:0.0:1787572567.928148:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787572567.928155:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:14381:x1874405268494848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787572567.928170:0:14379:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787572567.928186:0:14379:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787572567.928189:0:14379:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787572567.929387:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:14381:x1874405268494848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1227us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572567.929399:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787572567.929456:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268494848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787572567.929527:0:14381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787572567.929538:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f4375cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4375d6 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572567.929548:0:14381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1462000/0x9fe530ef4f4375cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f4375d6 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572568.946668:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572569.968597:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572570.990733:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572571.119875:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268494976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572571.119951:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572571.120068:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268494976 00000100:00100000:2.0:1787572571.120076:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268494976 00000100:00100000:2.0:1787572571.120145:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787572571.120156:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268494976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572571.120196:0:15070:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572571.120244:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268494976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572571.120252:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787572571.120390:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572571.120428:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268494976:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787572571.630830:0:473:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787572571.630838:0:473:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787572571.630841:0:473:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787572571.630863:0:473:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1787572571.630877:0:473:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787572571.630886:0:473:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d1de1f6800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1787572571.630911:0:473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d1f452bb80 x1874405268495232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787572571.631272:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268495360:0@lo:400:kworker.0 00000100:00100000:1.0:1787572571.631340:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572571.631397:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572571.631403:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268495488:0@lo:400:kworker.0 00000100:00100000:1.0:1787572571.631426:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572571.631463:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268495360 00000100:00100000:1.0:1787572571.631470:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268495360 00000100:00100000:2.0:1787572571.631674:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268495104:0@lo:400:kworker.0 00000100:00100000:2.0:1787572571.631712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572571.631737:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787572571.631743:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268495616:0@lo:400:kworker.0 00000100:00100000:2.0:1787572571.631765:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572571.633936:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f452bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268495232:0@lo:8:kworker.0 00000100:00100000:2.0:1787572571.633988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572571.634088:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268495104 00000100:00100000:2.0:1787572571.634094:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268495104 00000100:00100000:2.0:1787572571.634147:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787572571.634156:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3311:x1874405268495104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572571.634209:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3311:x1874405268495104:12345-0@lo:400:kworker.0 Request processed in 55us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572571.634217:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787572571.638270:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268495488 00000100:00100000:1.0:1787572571.638287:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268495488 00000100:00100000:1.0:1787572571.638365:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268495616 00000100:00100000:1.0:1787572571.638368:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268495616 00000100:00100000:1.0:1787572571.638392:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787572571.638404:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268495360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572571.638508:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268495360:12345-0@lo:400:kworker.0 Request processed in 94us (7155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572571.640904:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268495232 00000100:00100000:3.0:1787572571.640922:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268495232 00000100:00100000:3.0:1787572571.640964:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572571.640973:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1874405268495232:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787572571.641007:0:15068:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:3.0:1787572571.641037:0:15068:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9fe530ef4f4375dd 00002000:00100000:3.0:1787572571.641054:0:15068:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98d0c7461000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787572571.641058:0:15068:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787572571.641061:0:15068:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787572571.641401:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268495104:0@lo:400:kworker.0 00000100:00100000:2.0:1787572571.641436:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787572571.641448:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268495488:12345-0@lo:400:kworker.0 00002000:00080000:3.0:1787572571.641602:0:15068:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787572571.641631:0:15068:0:(import.c:65:import_set_state_nolock()) ffff98d0c7465000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787572571.641708:0:14385:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787572571.641723:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874405268495232:12345-0@lo:8:kworker.0 Request processed in 749us (7734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572571.641727:0:14385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787572571.641733:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572571.641763:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787572571.641773:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787572571.641792:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268495616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572571.641839:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268495616:12345-0@lo:400:kworker.0 Request processed in 50us (10073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572571.641847:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787572571.642100:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f452bb80 x1874405268495232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787572596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787572571.642112:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787572571.642119:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787572571.642128:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787572571.642133:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787572571.642136:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98d1de1f6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787572571.642154:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787572571.642160:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874405268495232:0@lo:8:kworker.0 00000004:00080000:0.0:1787572571.642243:0:14407:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787572571.642282:0:14408:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787572571.642303:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14408:1874405268495872:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787572571.642339:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572571.642362:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572571.642375:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572571.642383:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268495744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572571.642414:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572571.642669:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787572571.642893:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268495872 00000100:00100000:3.0:1787572571.642900:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268495872 00000100:00100000:3.0:1787572571.642941:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787572571.642948:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14408:x1874405268495872:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787572571.643006:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268495488:12345-0@lo:400:kworker.0 Request processed in 1561us (11577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572571.643016:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787572571.644451:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787572571.644459:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1787572571.645463:0:14407:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 501741826038ns, next at 0ns, rc = 0 00010000:00080000:0.0:1787572571.646769:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f452a300 x1874405268495488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572571.646787:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268495488:0@lo:400:kworker.0 00010000:00080000:0.0:1787572571.646802:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f452b800 x1874405268495360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572571.646811:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f452b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268495360:0@lo:400:kworker.0 00000100:00100000:0.0:1787572571.647126:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268495744 00000100:00100000:0.0:1787572571.647136:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268495744 00000100:00100000:0.0:1787572571.647188:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787572571.647199:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874405268495744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787572571.647238:0:15070:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787572571.647317:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874405268495744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (4901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572571.647325:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787572571.647448:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d0c624b800 x1874405268495744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787572587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572571.647466:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268495744:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787572571.647513:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d1f4528000 x1874405268495616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787572587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787572571.647522:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268495616:0@lo:400:kworker.0 00002000:00080000:0.0:1787572571.648837:0:15066:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787572571.648844:0:15066:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787572571.648850:0:15066:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1787572571.683361:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.683379:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.683403:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.683408:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.683414:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.683431:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.683443:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.683451:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.683475:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787572571.683564:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572571.683573:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.683584:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572571.683597:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.683607:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.683629:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.683661:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038fb7972/0x9fe530ef4f4375e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.683679:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.683681:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.683683:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.686603:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.686619:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.686659:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.686665:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.686673:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.686688:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.686711:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.686720:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.686739:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787572571.688304:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.688314:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.688329:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.688333:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.688338:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.688352:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.688361:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.688369:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.688404:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787572571.688999:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.689007:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689017:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.689021:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.689025:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689035:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689043:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689050:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689074:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787572571.689091:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787572571.689101:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689111:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572571.689116:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689127:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689146:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689162:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d652f5ba/0x9fe530ef4f4375eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787572571.689488:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.689511:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689521:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.689530:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.689535:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689546:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689550:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787572571.689557:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689559:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689576:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.689580:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689582:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689604:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.689605:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787572571.689621:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689629:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087aed4d0/0x9fe530ef4f4375f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689668:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787572571.689671:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689678:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572571.689688:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689697:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689708:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689716:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c10a142b/0x9fe530ef4f4375f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689734:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572571.689738:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689745:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eba00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572571.689749:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689757:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689767:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689774:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a92e0727/0x9fe530ef4f437600 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.689800:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.689803:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.689805:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.690098:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.690104:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.690113:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.690116:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.690121:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.690131:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.690140:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.690154:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.690174:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787572571.690342:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572571.690349:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.690430:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eaa00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572571.690435:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787572571.690574:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.690580:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.690589:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.690592:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.690600:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.690604:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.690613:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.690620:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.690624:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.690661:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f437607 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.690678:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.690680:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.690682:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572571.691095:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.694018:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.697013:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.697102:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787572571.698290:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572571.698301:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.698331:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572571.698336:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.698348:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.698371:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.698379:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f43760e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.698401:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.698403:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.698406:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.702270:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.702283:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702308:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.702314:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.702321:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702335:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702345:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702352:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702370:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787572571.702826:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.702832:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702841:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.702845:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.702849:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702860:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702879:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702886:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.702902:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787572571.703391:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787572571.703399:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703409:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eac00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572571.703414:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703425:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703451:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703458:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19f1e2d/0x9fe530ef4f437615 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703480:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572571.703484:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703490:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572571.703503:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703510:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703520:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703527:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000061a34a9/0x9fe530ef4f43761c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572571.703539:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.703540:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572571.703547:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.704236:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.707802:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.707815:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.707832:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.707837:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.707843:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.707857:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.707877:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.707886:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.709122:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787572571.709763:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.709772:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.709788:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.709792:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.709798:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.709810:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.709819:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.709827:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.709846:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787572571.710572:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.710580:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.710677:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.710689:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.710694:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.710704:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.710714:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.710721:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.710742:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787572571.711350:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.711357:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.711368:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.711371:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.711375:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.711384:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.711392:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.711404:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.711412:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787572571.716480:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.716504:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.716523:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.716528:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.716534:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.716549:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.716561:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.716569:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.716581:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1787572571.717700:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787572571.717714:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717727:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.717733:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717743:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717765:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717772:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abb81efe/0x9fe530ef4f437623 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717798:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787572571.717802:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717808:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.717811:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717832:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717841:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717848:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f43762a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717861:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787572571.717876:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717883:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.717887:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717894:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717903:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717910:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b233f2d4/0x9fe530ef4f437631 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717934:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787572571.717939:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717952:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671e00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.717955:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717963:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717972:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717979:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcda7506/0x9fe530ef4f437638 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.717991:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572571.717994:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.718000:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.718003:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.718021:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.718031:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.718038:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a61edbc6/0x9fe530ef4f43763f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.718050:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.718052:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.718054:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.718061:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.718065:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.720767:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.720780:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.720802:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.720806:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.720812:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.720827:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.720836:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.720843:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.720882:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572571.720898:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572571.720904:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.720911:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.720916:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.720925:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.721058:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.721066:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfe1b8d/0x9fe530ef4f437646 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.721083:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.721085:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.721087:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.722075:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.722082:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.722093:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.722097:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.722101:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.722112:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.722119:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.722126:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.724017:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572571.726735:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572571.726750:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.726766:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.726772:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.726783:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.729017:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.729049:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e771376/0x9fe530ef4f43764d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.729075:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.729077:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.729079:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.740076:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.740091:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740109:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.740113:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.740120:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740136:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740146:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740155:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740177:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787572571.740594:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.740600:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740609:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.740618:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.740623:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740654:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740663:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740669:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740685:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787572571.740700:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787572571.740705:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740713:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.740718:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740727:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740744:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740763:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3dec2c3/0x9fe530ef4f437654 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740782:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572571.740785:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740791:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670e00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.740794:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740801:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740812:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740819:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1e5fce/0x9fe530ef4f43765b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.740830:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.740832:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.740834:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.741226:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.741233:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741247:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.741251:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.741255:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741265:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741272:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741279:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741295:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787572571.741721:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.741727:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741736:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.741739:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.741743:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741753:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741773:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741780:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741794:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787572571.741802:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787572571.741807:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.741814:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.743336:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743355:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743378:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743385:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003af1b60f/0x9fe530ef4f437662 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743409:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572571.743424:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743431:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670a00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.743434:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743442:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743452:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743458:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055272bcb/0x9fe530ef4f437669 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.743472:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.743473:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.743475:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.743733:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787572571.748395:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787572571.748409:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.748427:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=501s v=(0 0) 00010000:00010000:2.0:1787572571.748437:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572571.748444:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.748458:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.748469:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.748476:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.748506:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572571.748814:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572571.748822:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.748830:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276e00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.748834:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.748854:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.750032:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.750046:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c9c7115/0x9fe530ef4f437670 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.750069:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.750071:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.750073:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787572571.751030:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787572571.751040:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.751055:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=501s v=(0 0) 00010000:00010000:2.0:1787572571.751060:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572571.751065:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.751078:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.751088:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.751105:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.751123:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572571.753472:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572571.753484:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.753509:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.753513:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.753523:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.753544:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.753552:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964123b6/0x9fe530ef4f437677 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.753573:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.753575:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.753586:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787572571.754360:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787572571.754370:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.754385:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=501s v=(0 0) 00010000:00010000:2.0:1787572571.754389:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572571.754395:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.754407:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.754416:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.754423:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.754444:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572571.755271:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572571.755280:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.755291:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc276200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.755296:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.755305:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.755322:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.755347:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f5add29/0x9fe530ef4f43767e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.755366:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.755373:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.755376:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.755757:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787572571.758973:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1787572571.759395:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787572571.759411:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.759427:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=501s v=(0 0) 00010000:00010000:2.0:1787572571.759431:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572571.759437:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.759450:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.759460:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.759467:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572571.759483:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787572571.760017:0:14373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572571.760026:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.760035:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.760040:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.760051:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.760068:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.760076:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69122ca/0x9fe530ef4f437685 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.760094:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.760096:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.760098:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.766340:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.766355:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766374:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.766379:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.766386:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766402:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766414:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766422:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766443:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787572571.766458:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787572571.766472:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766480:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4670400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572571.766485:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766505:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766522:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766529:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d90cbeab/0x9fe530ef4f43768c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.766549:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.766551:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572571.766553:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572571.767131:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.767138:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.767147:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.767151:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.767817:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.767844:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.767853:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.767860:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.767933:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787572571.768547:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787572571.768555:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.768568:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1787572571.768571:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572571.768575:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.768584:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787572571.769177:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787572571.769312:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.769334:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572571.769351:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1787572571.769576:0:15066:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:0.0:1787572571.769735:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787572571.769743:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769751:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.769755:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769772:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769789:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769797:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968994be/0x9fe530ef4f437693 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769818:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787572571.769821:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769828:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671000 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572571.769831:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769838:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769848:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.769855:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a5892fb/0x9fe530ef4f43769a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572571.770136:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.770138:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.770140:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572571.770154:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572571.771121:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14408:x1874405268495872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 128166us (128774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572571.771132:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787572571.773617:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14408:1874405268495872:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787572571.773800:0:14408:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787572571.773914:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14408:1874405268496000:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787572571.774093:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572571.774160:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1de2306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572571.774285:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268496000 00000100:00100000:2.0:1787572571.774293:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268496000 00000100:00100000:2.0:1787572571.774357:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787572571.774367:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14408:x1874405268496000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787572571.774419:0:15068:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787572571.785630:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14408:x1874405268496000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11252us (11526us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787572571.785663:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787572571.785752:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14408:1874405268496000:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787572571.785769:0:14408:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1787572572.014856:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787572573.040937:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787572573.662474:0:16147:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787572574.063427:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572575.089792:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572575.907737:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572575.913306:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244380672 00000100:00100000:2.0:1787572575.913328:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244380672 00000100:00100000:2.0:1787572575.913556:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:2.0:1787572575.913567:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1874405244380672:12345-192.168.204.55@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787572575.913599:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb@192.168.204.55@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1787572575.913658:0:14379:0:(genops.c:1385:class_connect()) connect: client 421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb, cookie 0x9fe530ef4f4376a1 00000100:00080000:2.0:1787572575.913825:0:14379:0:(import.c:65:import_set_state_nolock()) ffff98d0c7364800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787572575.914031:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+5:2352:x1874405244380672:12345-192.168.204.55@tcp:250:mount.lustre.0 Request processed in 463us (6301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572575.914039:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:2.0:1787572575.926735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572575.927150:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244380800 00000100:00100000:3.0:1787572575.927163:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244380800 00000100:00100000:3.0:1787572575.927285:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:3.0:1787572575.927296:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+5:13752:x1874405244380800:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787572575.927313:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572575.927332:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670400/0x9fe530ef4f4376a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd2b expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572575.927360:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670400/0x9fe530ef4f4376a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd2b expref: 6 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572575.927371:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670400/0x9fe530ef4f4376a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd2b expref: 6 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572575.927399:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670400, rc 0) 00000100:00100000:3.0:1787572575.927468:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+6:13752:x1874405244380800:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 174us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572575.927475:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:3.0:1787572575.932163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572575.932429:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244380928 00000100:00100000:0.0:1787572575.932439:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244380928 00000100:00100000:0.0:1787572575.932508:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:0.0:1787572575.932520:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f3f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+6:13752:x1874405244380928:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787572575.932807:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f3f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+6:13752:x1874405244380928:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 290us (655us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787572575.932814:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:0.0:1787572575.936095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572575.936264:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244381056 00000100:00100000:3.0:1787572575.936275:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244381056 00000100:00100000:3.0:1787572575.936364:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:3.0:1787572575.936375:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+6:13752:x1874405244381056:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787572575.936394:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572575.936422:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670a00/0x9fe530ef4f4376af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd32 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572575.936454:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670a00/0x9fe530ef4f4376af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd32 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572575.936465:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670a00/0x9fe530ef4f4376af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd32 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572575.936476:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670a00, rc 0) 00000100:00100000:3.0:1787572575.936544:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+7:13752:x1874405244381056:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 170us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572575.936551:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:1.0:1787572575.939853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572575.941401:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244381184 00000100:00100000:2.0:1787572575.941425:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244381184 00000100:00100000:2.0:1787572575.941538:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:2.0:1787572575.941551:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+7:13752:x1874405244381184:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787572575.941897:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+8:13752:x1874405244381184:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 349us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572575.941906:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:1.0:1787572575.948093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572575.948409:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244381312 00000100:00100000:3.0:1787572575.948430:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244381312 00000100:00100000:3.0:1787572575.948488:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:3.0:1787572575.948513:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+8:13752:x1874405244381312:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787572575.948841:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+8:13752:x1874405244381312:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 329us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572575.948850:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:1.0:1787572575.957607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572575.957850:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244381440 00000100:00100000:2.0:1787572575.957920:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244381440 00000100:00100000:2.0:1787572575.957977:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:2.0:1787572575.957988:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+8:13769:x1874405244381440:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787572575.958288:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+8:13769:x1874405244381440:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 300us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572575.958297:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:1.0:1787572575.974452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572575.974691:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244381568 00000100:00100000:0.0:1787572575.974705:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244381568 00000100:00100000:0.0:1787572575.974782:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:0.0:1787572575.974794:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+8:13769:x1874405244381568:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787572575.975259:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+8:13769:x1874405244381568:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 466us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572575.975322:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:1.0:1787572575.983301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572575.983733:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244381696 00000100:00100000:2.0:1787572575.983747:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244381696 00000100:00100000:2.0:1787572575.983809:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:2.0:1787572575.983825:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+8:13752:x1874405244381696:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787572575.983845:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572575.983864:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1fc276e00/0x9fe530ef4f4376b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd5c expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572575.983907:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1fc276e00/0x9fe530ef4f4376b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd5c expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572575.983929:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1fc276e00/0x9fe530ef4f4376b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd5c expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572575.983938:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276e00, rc 0) 00000100:00100000:2.0:1787572575.984022:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+9:13752:x1874405244381696:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 198us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572575.984029:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:1.0:1787572576.007399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572576.007564:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244381824 00000100:00100000:0.0:1787572576.007577:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244381824 00000100:00100000:0.0:1787572576.007679:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:0.0:1787572576.007693:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+9:13752:x1874405244381824:12345-192.168.204.55@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787572576.007722:0:14378:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787572576.007750:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787572576.007755:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787572576.007758:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787572576.007761:0:14378:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787572576.032692:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+9:13752:x1874405244381824:12345-192.168.204.55@tcp:256:mount.lustre.0 Request processed in 24989us (25292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572576.032784:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:1.0:1787572576.043573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572576.043811:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244381952 00000100:00100000:2.0:1787572576.043822:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244381952 00000100:00100000:3.0:1787572576.044066:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:3.0:1787572576.044079:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+9:13752:x1874405244381952:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787572576.044099:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572576.044117:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd63 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572576.044146:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572576.044158:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572576.044169:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671200, rc 0) 00000100:00100000:3.0:1787572576.044233:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13752:x1874405244381952:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 157us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572576.044240:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:1.0:1787572576.051489:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572576.051682:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244382080 00000100:00100000:0.0:1787572576.051693:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244382080 00000100:00100000:0.0:1787572576.051811:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:0.0:1787572576.051825:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13752:x1874405244382080:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787572576.052151:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13752:x1874405244382080:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 329us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572576.052160:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:1.0:1787572576.056341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572576.056435:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244382208 00000100:00100000:3.0:1787572576.056445:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244382208 00000100:00100000:3.0:1787572576.056620:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:3.0:1787572576.056630:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13752:x1874405244382208:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787572576.056920:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13752:x1874405244382208:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 290us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572576.056935:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:1.0:1787572576.062373:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572576.062560:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244382336 00000100:00100000:0.0:1787572576.062572:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244382336 00000100:00100000:0.0:1787572576.062721:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 88 00000100:00100000:0.0:1787572576.062735:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d0978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13775:x1874405244382336:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787572576.063086:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d0978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13775:x1874405244382336:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 354us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572576.063103:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 88 00000100:00100000:1.0:1787572576.070303:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572576.072496:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244382464 00000100:00100000:3.0:1787572576.072511:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244382464 00000100:00100000:3.0:1787572576.072663:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 89 00000100:00100000:3.0:1787572576.072675:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13775:x1874405244382464:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787572576.074731:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13775:x1874405244382464:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 2043us (4428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572576.074746:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 89 00000100:00100000:1.0:1787572576.082515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572576.084673:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244382592 00000100:00100000:0.0:1787572576.084687:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244382592 00000100:00100000:0.0:1787572576.084752:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:0.0:1787572576.084762:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1874405244382592:12345-192.168.204.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787572576.084793:0:14385:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 14621f29-0314-45be-9667-d365740545a2@192.168.204.55@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1787572576.084869:0:14385:0:(genops.c:1385:class_connect()) connect: client 14621f29-0314-45be-9667-d365740545a2, cookie 0x9fe530ef4f4376c4 00000004:00100000:0.0:1787572576.084904:0:14385:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787572576.084910:0:14385:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787572576.113728:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787572576.157198:0:14385:0:(import.c:65:import_set_state_nolock()) ffff98d0c7466000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787572576.157286:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+6:2352:x1874405244382592:12345-192.168.204.55@tcp:38:mount.lustre.0 Request processed in 72523us (74787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572576.157298:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:1.0:1787572576.164334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572576.164375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572576.164477:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244382848 00000100:00100000:2.0:1787572576.164488:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244382848 00000100:00100000:2.0:1787572576.164562:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244382720 00000100:00100000:2.0:1787572576.164566:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244382720 00000100:00100000:2.0:1787572576.164586:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:2.0:1787572576.164597:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+7:13752:x1874405244382848:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787572576.164681:0:14384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787572576.164775:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+7:13752:x1874405244382848:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 179us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572576.164796:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:2.0:1787572576.164814:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:2.0:1787572576.164821:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+6:0:x1874405244382720:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787572576.164832:0:14384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787572576.164855:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+6:0:x1874405244382720:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 35us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572576.164873:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00080000:1.0:1787572576.165212:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572576.172970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572576.173060:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244382976 00000100:00100000:3.0:1787572576.173069:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244382976 00000100:00100000:3.0:1787572576.173138:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1787572576.173157:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+6:13752:x1874405244382976:12345-192.168.204.55@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787572576.173256:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+6:13752:x1874405244382976:12345-192.168.204.55@tcp:40:mount.lustre.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572576.173264:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:1.0:1787572576.177280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572576.177327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572576.177356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572576.177406:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244383104 00000100:00100000:1.0:1787572576.177428:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244383104 00000100:00100000:1.0:1787572576.177473:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244383232 00000100:00100000:1.0:1787572576.177477:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244383232 00000100:00100000:1.0:1787572576.177492:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1787572576.177502:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874405244383104:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787572576.177538:0:15067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 14621f29-0314-45be-9667-d365740545a2@192.168.204.55@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:1.0:1787572576.177594:0:15067:0:(genops.c:1385:class_connect()) connect: client 14621f29-0314-45be-9667-d365740545a2, cookie 0x9fe530ef4f4376cb 00002000:00100000:1.0:1787572576.177610:0:15067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14621f29-0314-45be-9667-d365740545a2/ffff98d0c7043000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787572576.177665:0:15067:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787572576.177988:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244383360 00000100:00100000:0.0:1787572576.177993:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244383360 00000100:00100000:0.0:1787572576.178035:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:0.0:1787572576.178044:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+6:13752:x1874405244383360:12345-192.168.204.55@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787572576.179727:0:14386:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1622us 00002000:00080000:1.0:1787572576.179822:0:15067:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787572576.180030:0:15067:0:(import.c:65:import_set_state_nolock()) ffff98d0c7045000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787572576.180171:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14621f29-0314-45be-9667-d365740545a2+6:2352:x1874405244383104:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 2666us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572576.180182:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1787572576.180214:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1787572576.180222:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874405244383232:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787572576.180248:0:15067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 14621f29-0314-45be-9667-d365740545a2@192.168.204.55@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:1.0:1787572576.180276:0:15067:0:(genops.c:1385:class_connect()) connect: client 14621f29-0314-45be-9667-d365740545a2, cookie 0x9fe530ef4f4376d2 00002000:00100000:1.0:1787572576.180288:0:15067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14621f29-0314-45be-9667-d365740545a2/ffff98d0c7040000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787572576.180313:0:15067:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787572576.180514:0:15067:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787572576.180533:0:15067:0:(import.c:65:import_set_state_nolock()) ffff98d0c7044000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787572576.180561:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14621f29-0314-45be-9667-d365740545a2+6:2352:x1874405244383232:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 337us (3204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572576.180568:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000004:00200000:1.0:1787572576.208811:0:14386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787572576.209010:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+6:13752:x1874405244383360:12345-192.168.204.55@tcp:33:mount.lustre.0 Request processed in 30961us (31733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572576.209025:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:0.0:1787572576.238991:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268496128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787572576.239081:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572576.239763:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268496128 00000100:00100000:2.0:1787572576.239773:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268496128 00000100:00100000:2.0:1787572576.239851:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787572576.239870:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268496128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572576.239897:0:15070:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572576.239958:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268496128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572576.239965:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787572576.240013:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268496128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787572576.240372:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787572576.478342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572576.479557:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244383488 00000100:00100000:0.0:1787572576.479576:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244383488 00000100:00100000:0.0:1787572576.479744:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:0.0:1787572576.479760:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+6:13796:x1874405244383488:12345-192.168.204.55@tcp:101:mkdir.0 00010000:00010000:0.0:1787572576.479791:0:16006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572576.480168:0:16006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31a00/0x9fe530ef4f4376d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd8d expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572576.480289:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30400/0x9fe530ef4f4376e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572576.480307:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30400/0x9fe530ef4f4376e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572576.480326:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30400/0x9fe530ef4f4376e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572576.482250:0:16006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787572576.482262:0:16006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572576.483929:0:16006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30400/0x9fe530ef4f4376e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572576.484001:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31a00/0x9fe530ef4f4376d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd8d expref: 8 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572576.484028:0:16006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30400/0x9fe530ef4f4376e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd8d expref: 7 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572576.484039:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149900) 00010000:00010000:0.0:1787572576.484043:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572576.484047:0:16006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30400, rc 0) 00000100:00100000:0.0:1787572576.484153:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+7:13796:x1874405244383488:12345-192.168.204.55@tcp:101:mkdir.0 Request processed in 4396us (5825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572576.484163:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:0.0:1787572576.752021:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572576.752053:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268496256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572576.752671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572576.753151:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268496256 00000100:00100000:3.0:1787572576.753163:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268496256 00000100:00100000:3.0:1787572576.753250:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572576.753264:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268496256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572576.753296:0:15070:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572576.753374:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268496256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572576.753382:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787572576.753542:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572576.754312:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268496640:0@lo:400:kworker.0 00000100:00100000:0.0:1787572576.754371:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572576.754450:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268496256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787572576.754478:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572576.754483:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874405268496768:0@lo:400:kworker.0 00000100:00100000:0.0:1787572576.754508:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572576.754538:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268496640 00000100:00100000:0.0:1787572576.754546:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268496640 00000100:00100000:0.0:1787572576.754610:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268496768 00000100:00100000:0.0:1787572576.754614:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268496768 00000100:00100000:0.0:1787572576.754664:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787572576.754674:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268496640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572576.754721:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874405268496640:12345-0@lo:400:kworker.0 Request processed in 49us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572576.754727:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787572576.754745:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787572576.754752:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874405268496768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572576.754779:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874405268496768:12345-0@lo:400:kworker.0 Request processed in 29us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572576.754785:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787572576.754817:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874405268496768:0@lo:400:kworker.0 00000100:00100000:0.0:1787572576.754828:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874405268496640:0@lo:400:kworker.0 00000100:00100000:1.0:1787572576.755225:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268496512:0@lo:400:kworker.0 00000100:00100000:1.0:1787572576.755265:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572576.755293:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572576.755299:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268496384:0@lo:400:kworker.0 00000100:00100000:1.0:1787572576.755331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572576.755385:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268496384 00000100:00100000:1.0:1787572576.755390:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268496384 00000100:00100000:1.0:1787572576.755442:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787572576.755450:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d097b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3311:x1874405268496384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572576.755492:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d097b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3311:x1874405268496384:12345-0@lo:400:kworker.0 Request processed in 43us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572576.755499:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787572576.755529:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572576.755551:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268496384:0@lo:400:kworker.0 00000100:00100000:1.0:1787572576.755596:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268496512 00000100:00100000:1.0:1787572576.755600:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268496512 00000100:00100000:1.0:1787572576.755628:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787572576.755674:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268496512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572576.755713:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874405268496512:12345-0@lo:400:kworker.0 Request processed in 78us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572576.755720:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787572576.755748:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874405268496512:0@lo:400:kworker.0 00000001:00100000:1.0:1787572576.864353:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14621f29-0314-45be-9667-d365740545a2 00000001:00080000:1.0:1787572576.864381:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1787572577.135029:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787572577.584551:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787572578.159098:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572578.439582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572578.439705:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244383616 00000100:00100000:0.0:1787572578.439743:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244383616 00000100:00100000:0.0:1787572578.439828:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:0.0:1787572578.439848:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+7:13848:x1874405244383616:12345-192.168.204.55@tcp:41:lfs.0 00000004:00000024:0.0:1787572578.439898:0:15089:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787572578.440000:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+7:13848:x1874405244383616:12345-192.168.204.55@tcp:41:lfs.0 Request processed in 162us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572578.440008:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:1.0:1787572578.440082:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572578.454352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572578.462899:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244383744 00000100:00100000:3.0:1787572578.462920:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244383744 00000100:00100000:3.0:1787572578.463049:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1787572578.463077:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14621f29-0314-45be-9667-d365740545a2+6:13848:x1874405244383744:12345-192.168.204.55@tcp:13:lfs.0 00002000:00000024:3.0:1787572578.463144:0:15070:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572578.463270:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14621f29-0314-45be-9667-d365740545a2+6:13848:x1874405244383744:12345-192.168.204.55@tcp:13:lfs.0 Request processed in 211us (8932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.463279:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1787572578.470784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00080000:1.0:1787572578.470978:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787572578.472038:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244383872 00000100:00100000:2.0:1787572578.472073:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244383872 00000100:00100000:2.0:1787572578.472243:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1787572578.472259:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14621f29-0314-45be-9667-d365740545a2+5:13848:x1874405244383872:12345-192.168.204.55@tcp:13:lfs.0 00002000:00000024:2.0:1787572578.472316:0:15070:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572578.472460:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14621f29-0314-45be-9667-d365740545a2+5:13848:x1874405244383872:12345-192.168.204.55@tcp:13:lfs.0 Request processed in 206us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572578.472467:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00080000:1.0:1787572578.477652:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787572578.769804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572578.770996:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244384000 00000100:00100000:3.0:1787572578.771016:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244384000 00000100:00100000:3.0:1787572578.771247:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:3.0:1787572578.771263:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+10:13884:x1874405244384000:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787572578.771288:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572578.771314:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670e00/0x9fe530ef4f4376e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbd94 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.771353:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670e00/0x9fe530ef4f4376e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd94 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.771740:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670e00/0x9fe530ef4f4376e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd94 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.771753:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670e00, rc 0) 00000100:00100000:3.0:1787572578.771872:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13884:x1874405244384000:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 613us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.771881:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:3.0:1787572578.785988:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572578.786453:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244384128 00000100:00100000:2.0:1787572578.786469:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244384128 00000100:00100000:2.0:1787572578.786561:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 92 00000100:00100000:2.0:1787572578.786575:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13884:x1874405244384128:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787572578.787409:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13884:x1874405244384128:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 831us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572578.787420:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 92 00000100:00100000:1.0:1787572578.793497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572578.804413:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244384256 00000100:00100000:3.0:1787572578.804435:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244384256 00000100:00100000:3.0:1787572578.804526:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:3.0:1787572578.804539:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13884:x1874405244384256:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787572578.804896:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13884:x1874405244384256:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 359us (11415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.804904:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:2.0:1787572578.828105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572578.828222:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244384384 00000100:00100000:0.0:1787572578.828236:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244384384 00000100:00100000:0.0:1787572578.828324:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:0.0:1787572578.828338:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13888:x1874405244384384:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787572578.828758:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13888:x1874405244384384:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 422us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572578.828767:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:0.0:1787572578.857817:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572578.857933:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244384512 00000100:00100000:1.0:1787572578.857950:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244384512 00000100:00100000:1.0:1787572578.858025:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:1.0:1787572578.858038:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13888:x1874405244384512:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787572578.875975:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13888:x1874405244384512:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 17921us (18169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572578.875995:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:1.0:1787572578.885110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572578.885922:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244384640 00000100:00100000:3.0:1787572578.885940:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244384640 00000100:00100000:3.0:1787572578.886033:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 96 00000100:00100000:3.0:1787572578.886048:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13884:x1874405244384640:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787572578.886248:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572578.886277:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670800/0x9fe530ef4f4376ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbdbe expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.886319:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670800/0x9fe530ef4f4376ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdbe expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.886333:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670800/0x9fe530ef4f4376ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdbe expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.886344:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670800, rc 0) 00000100:00100000:3.0:1787572578.886447:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13884:x1874405244384640:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 401us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.886475:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 96 00000100:00100000:3.0:1787572578.893020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572578.894499:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244384768 00000100:00100000:2.0:1787572578.894519:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244384768 00000100:00100000:2.0:1787572578.894626:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:2.0:1787572578.894686:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13884:x1874405244384768:12345-192.168.204.55@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787572578.894724:0:14378:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787572578.894758:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787572578.894764:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787572578.894768:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787572578.894771:0:14378:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787572578.897322:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13884:x1874405244384768:12345-192.168.204.55@tcp:256:mount.lustre.0 Request processed in 2669us (4303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572578.897342:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:0.0:1787572578.904874:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572578.905013:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244384896 00000100:00100000:3.0:1787572578.905027:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244384896 00000100:00100000:3.0:1787572578.905137:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 98 00000100:00100000:3.0:1787572578.905152:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13884:x1874405244384896:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787572578.905178:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572578.905202:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbdc5 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.905241:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.905253:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572578.905264:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670200, rc 0) 00000100:00100000:3.0:1787572578.905431:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13884:x1874405244384896:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 282us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.905439:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 98 00000100:00100000:3.0:1787572578.909129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572578.909283:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244385024 00000100:00100000:1.0:1787572578.909301:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244385024 00000100:00100000:1.0:1787572578.909392:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:1.0:1787572578.909406:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13884:x1874405244385024:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787572578.910910:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13884:x1874405244385024:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 1495us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572578.911134:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:0.0:1787572578.917549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572578.917686:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244385152 00000100:00100000:3.0:1787572578.917700:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244385152 00000100:00100000:3.0:1787572578.917781:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:3.0:1787572578.917794:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13884:x1874405244385152:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787572578.918164:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13884:x1874405244385152:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 370us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.918183:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:3.0:1787572578.924964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572578.925397:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244385280 00000100:00100000:0.0:1787572578.925414:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244385280 00000100:00100000:0.0:1787572578.925503:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:0.0:1787572578.925518:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13893:x1874405244385280:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787572578.926414:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13893:x1874405244385280:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 895us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572578.926438:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:2.0:1787572578.938675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572578.938841:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244385408 00000100:00100000:0.0:1787572578.938861:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244385408 00000100:00100000:0.0:1787572578.938974:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 102 00000100:00100000:0.0:1787572578.938989:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13893:x1874405244385408:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787572578.939841:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13893:x1874405244385408:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 851us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572578.939854:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 102 00000100:00100000:1.0:1787572578.984335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572578.984478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572578.984522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572578.984608:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244386048 00000100:00100000:3.0:1787572578.984626:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244386048 00000100:00100000:3.0:1787572578.984733:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1787572578.984750:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+6:2353:x1874405244386048:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572578.984868:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+6:2353:x1874405244386048:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 122us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.984877:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:1.0:1787572578.986092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572578.986124:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244386176 00000100:00100000:1.0:1787572578.986133:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244386176 00000100:00100000:1.0:1787572578.986179:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:1.0:1787572578.986189:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14621f29-0314-45be-9667-d365740545a2+5:2353:x1874405244386176:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572578.986270:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14621f29-0314-45be-9667-d365740545a2+5:2353:x1874405244386176:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572578.986278:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1787572578.986385:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244385536 00000100:00100000:0.0:1787572578.986391:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244385536 00000100:00100000:3.0:1787572578.986438:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244385920 00000100:00100000:3.0:1787572578.986444:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244385920 00000100:00100000:3.0:1787572578.986497:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:3.0:1787572578.986507:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+7:2353:x1874405244385920:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572578.986567:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+7:2353:x1874405244385920:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 62us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.986574:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:3.0:1787572578.986590:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1787572578.986595:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1874405244385536:12345-192.168.204.55@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787572578.986625:0:14383:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f@192.168.204.55@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1787572578.986689:0:14383:0:(genops.c:1385:class_connect()) connect: client 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f, cookie 0x9fe530ef4f4376fc 00000004:00100000:3.0:1787572578.987162:0:14383:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787572578.987388:0:14383:0:(import.c:65:import_set_state_nolock()) ffff98d0c7464800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787572578.987435:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2352:x1874405244385536:12345-192.168.204.55@tcp:38:mount.lustre.0 Request processed in 836us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572578.987459:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:1.0:1787572579.000543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572579.000599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572579.000823:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244385792 00000100:00100000:3.0:1787572579.000840:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244385792 00000100:00100000:3.0:1787572579.000948:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244385664 00000100:00100000:3.0:1787572579.000952:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244385664 00000100:00080000:1.0:1787572579.001077:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572579.001192:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1787572579.001207:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+7:13884:x1874405244385792:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787572579.001282:0:14385:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787572579.001407:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+7:13884:x1874405244385792:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 202us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572579.001417:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1787572579.001441:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1787572579.001448:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:0:x1874405244385664:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787572579.001462:0:14385:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787572579.001485:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:0:x1874405244385664:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 37us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572579.001492:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1787572579.005262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572579.005479:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244386304 00000100:00100000:0.0:1787572579.005493:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244386304 00000100:00100000:0.0:1787572579.005698:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:0.0:1787572579.005712:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:13884:x1874405244386304:12345-192.168.204.55@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787572579.005834:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:13884:x1874405244386304:12345-192.168.204.55@tcp:40:mount.lustre.0 Request processed in 126us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572579.005843:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1787572579.008293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572579.008405:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244386432 00000100:00100000:1.0:1787572579.008419:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244386432 00000100:00100000:1.0:1787572579.008482:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:1.0:1787572579.008504:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874405244386432:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787572579.008547:0:15067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f@192.168.204.55@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:1.0:1787572579.008600:0:15067:0:(genops.c:1385:class_connect()) connect: client 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f, cookie 0x9fe530ef4f437703 00002000:00100000:1.0:1787572579.008616:0:15067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f/ffff98d0c7043800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787572579.008665:0:15067:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787572579.008826:0:15067:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787572579.008865:0:15067:0:(import.c:65:import_set_state_nolock()) ffff98d0c7047800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787572579.008959:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2352:x1874405244386432:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 466us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572579.008969:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:2.0:1787572579.009238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572579.009563:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244386560 00000100:00100000:3.0:1787572579.009572:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244386560 00000100:00100000:3.0:1787572579.009616:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1787572579.009624:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874405244386560:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787572579.009776:0:15066:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f@192.168.204.55@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1787572579.009876:0:15066:0:(genops.c:1385:class_connect()) connect: client 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f, cookie 0x9fe530ef4f43770a 00002000:00100000:3.0:1787572579.009889:0:15066:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f/ffff98d0c7467000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787572579.009920:0:15066:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787572579.010242:0:15066:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787572579.010275:0:15066:0:(import.c:65:import_set_state_nolock()) ffff98d0c7463000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787572579.011372:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2352:x1874405244386560:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 1721us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572579.011392:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1787572579.012913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572579.013028:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244386688 00000100:00100000:0.0:1787572579.013044:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244386688 00000100:00100000:0.0:1787572579.013126:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1787572579.013141:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:13884:x1874405244386688:12345-192.168.204.55@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787572579.013560:0:14387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787572579.013801:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:13884:x1874405244386688:12345-192.168.204.55@tcp:33:mount.lustre.0 Request processed in 662us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572579.013811:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00010000:00010000:3.0:1787572579.186286:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572579.257869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572579.258135:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244386816 00000100:00100000:3.0:1787572579.258145:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244386816 00000100:00100000:3.0:1787572579.258207:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:3.0:1787572579.258218:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:13914:x1874405244386816:12345-192.168.204.55@tcp:101:mkdir.0 00010000:00010000:3.0:1787572579.258240:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572579.258263:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f437711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbdef expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572579.258330:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572579.258346:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572579.258370:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572579.258601:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787572579.258606:0:14385:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572579.258715:0:14385:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572579.258744:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671000/0x9fe530ef4f437711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 8 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572579.258770:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 7 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572579.258780:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149900) 00010000:00010000:3.0:1787572579.258783:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787572579.258787:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671800, rc 0) 00000100:00100000:3.0:1787572579.259342:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+7:13914:x1874405244386816:12345-192.168.204.55@tcp:101:mkdir.0 Request processed in 1122us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572579.259363:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000001:00100000:0.0:1787572579.382631:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f 00000001:00100000:0.0:1787572579.382724:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14621f29-0314-45be-9667-d365740545a2 00010000:00010000:0.0:1787572580.207277:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572581.231295:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572581.359098:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787572581.359123:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268496896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572581.359213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572581.359290:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268496896 00000100:00100000:2.0:1787572581.359298:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268496896 00000100:00100000:2.0:1787572581.359370:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787572581.359383:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268496896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572581.359461:0:15070:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572581.359541:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268496896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572581.359550:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787572581.359602:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268496896:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787572581.359936:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787572581.485429:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f 00000001:00100000:0.0:1787572581.485447:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14621f29-0314-45be-9667-d365740545a2 00000100:00100000:0.0:1787572581.874031:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268497152:0@lo:400:kworker.0 00000100:00100000:0.0:1787572581.874103:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572581.874166:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787572581.874172:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268497280:0@lo:400:kworker.0 00000100:00100000:0.0:1787572581.874197:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572581.874230:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268497152 00000100:00100000:0.0:1787572581.874239:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268497152 00000100:00100000:0.0:1787572581.874295:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787572581.874324:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268497152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572581.874378:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268497152:12345-0@lo:400:kworker.0 Request processed in 63us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572581.874386:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787572581.874409:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572581.874420:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268497408:0@lo:400:kworker.0 00000100:00100000:0.0:1787572581.874445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572581.874465:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787572581.874470:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268497024:0@lo:400:kworker.0 00000100:00100000:0.0:1787572581.874498:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572581.874535:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268497536:0@lo:400:kworker.0 00000100:00100000:0.0:1787572581.874558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572581.874585:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268497280 00000100:00100000:0.0:1787572581.874603:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268497280 00000100:00100000:0.0:1787572581.874632:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268497408 00000100:00100000:0.0:1787572581.874657:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268497408 00000100:00100000:0.0:1787572581.874682:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268497536 00000100:00100000:0.0:1787572581.874685:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268497536 00000100:00100000:0.0:1787572581.874702:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787572581.874709:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268497280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572581.874742:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874405268497280:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572581.874890:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787572581.874899:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268497408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572581.874939:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874405268497408:12345-0@lo:400:kworker.0 Request processed in 42us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572581.874946:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787572581.874963:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787572581.874969:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268497536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572581.874996:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874405268497536:12345-0@lo:400:kworker.0 Request processed in 27us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572581.875001:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787572581.875013:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572581.875021:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268497664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572581.875048:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572581.875074:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268497664 00000100:00100000:3.0:1787572581.875079:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268497664 00000100:00100000:3.0:1787572581.875106:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787572581.875120:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268497664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787572581.875150:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572581.875190:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268497664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572581.875197:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787572581.875236:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787572581.875263:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268497664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572581.875291:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874405268497536:0@lo:400:kworker.0 00000100:00100000:3.0:1787572581.875315:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874405268497408:0@lo:400:kworker.0 00000100:00100000:3.0:1787572581.875363:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268497024 00000100:00100000:3.0:1787572581.875368:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268497024 00000100:00100000:3.0:1787572581.875397:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787572581.875404:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3310:x1874405268497024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572581.875441:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3310:x1874405268497024:12345-0@lo:400:kworker.0 Request processed in 38us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572581.875447:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787572581.875486:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874405268497280:0@lo:400:kworker.0 00000100:00100000:3.0:1787572581.875496:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268497152:0@lo:400:kworker.0 00000100:00100000:3.0:1787572581.875518:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268497024:0@lo:400:kworker.0 00000100:00080000:3.0:1787572581.875551:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787572581.875682:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000001:00100000:0.0:1787572581.967815:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1ed6e9a4-830e-4356-86ba-b5ac597b7c6f 00010000:00010000:3.0:1787572582.254848:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787572582.802746:0:16352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787572583.280983:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572584.255392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572584.255436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572584.255466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572584.255491:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244387072 00000100:00100000:0.0:1787572584.255495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572584.255504:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244387072 00000100:00100000:0.0:1787572584.255515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572584.255533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572584.255563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572584.255582:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244387328 00000100:00100000:0.0:1787572584.255586:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244387328 00000100:00100000:3.0:1787572584.255750:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244387456 00000100:00100000:3.0:1787572584.255761:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244387456 00000100:00100000:0.0:1787572584.255854:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244387584 00000100:00100000:0.0:1787572584.255859:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244387584 00000100:00100000:0.0:1787572584.255879:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244387200 00000100:00100000:0.0:1787572584.255882:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244387200 00000100:00100000:0.0:1787572584.255897:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244387712 00000100:00100000:0.0:1787572584.255900:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244387712 00000100:00100000:0.0:1787572584.255921:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:0.0:1787572584.255935:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244387328:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572584.256035:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:0.0:1787572584.256036:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244387328:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 103us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572584.256044:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+6:2354:x1874405244387072:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572584.256051:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:0.0:1787572584.256073:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:3.0:1787572584.256080:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+6:2354:x1874405244387072:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 39us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572584.256080:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244387584:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572584.256087:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:3.0:1787572584.256105:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:0.0:1787572584.256105:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244387584:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572584.256111:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2354:x1874405244387456:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572584.256112:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:0.0:1787572584.256121:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:0.0:1787572584.256128:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244387200:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572584.256132:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2354:x1874405244387456:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 22us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572584.256138:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:0.0:1787572584.256147:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244387200:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 21us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572584.256154:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:0.0:1787572584.256163:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1787572584.256169:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244387712:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572584.256196:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244387712:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572584.256202:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1787572584.256232:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244386944 00000100:00100000:0.0:1787572584.256235:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244386944 00000100:00100000:0.0:1787572584.256281:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:0.0:1787572584.256289:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:2354:x1874405244386944:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572584.256316:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:2354:x1874405244386944:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 30us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572584.256323:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00080000:0.0:1787572584.256824:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572584.256831:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787572584.256834:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787572584.309325:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572585.327188:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787572586.129554:0:16500:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff72b26270 20000000:00000080:1.0:1787572586.129586:0:16500:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d1f5d89400 uarg=0000000000000000 20000000:01000000:1.0:1787572586.129774:0:16500:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787572586.129788:0:16500:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787572586.129793:0:16500:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787572586.139693:0:16501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787572586.144194:0:16500:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787572586.158142:0:16500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787572586.158450:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158472:0:16500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158480:0:16500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158486:0:16500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158496:0:16500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158503:0:16500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158528:0:16500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158577:0:16500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158595:0:16500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 12 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572586.158612:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268497792:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572586.158768:0:16500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158777:0:16500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 12 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572586.158787:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268497920:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572586.158820:0:16500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158829:0:16500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 18 pid: 14376 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572586.158837:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6249f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268498048:0@lo:104: 00000100:00100000:3.0:1787572586.158877:0:16500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787572586.158917:0:16500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.158939:0:16500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 18 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572586.158947:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268498176:0@lo:104: 00000100:00100000:3.0:1787572586.158973:0:16500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787572586.159012:0:16500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.159022:0:16500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 18 pid: 14378 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572586.159028:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268498048 00000100:00100000:3.0:1787572586.159032:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268498304:0@lo:104: 00000100:00100000:1.0:1787572586.159038:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268498048 00000100:00100000:3.0:1787572586.159061:0:16500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572586.159072:0:16500:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1eae2b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787572586.159108:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787572586.159120:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268498176 00000100:00100000:1.0:1787572586.159123:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268498176 00000100:00100000:1.0:1787572586.159135:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268498304 00000100:00100000:1.0:1787572586.159138:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268498304 00000100:00100000:1.0:1787572586.159152:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787572586.159162:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6248380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39be3db9-5eba-42e2-9087-a4df3ec904cb+5:16500:x1874405268498048:12345-0@lo:104: 00010000:00010000:1.0:1787572586.159177:0:14368:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.159254:0:14368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787572586.159261:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6248380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39be3db9-5eba-42e2-9087-a4df3ec904cb+5:16500:x1874405268498048:12345-0@lo:104: Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572586.159270:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787572586.159291:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787572586.159298:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39be3db9-5eba-42e2-9087-a4df3ec904cb+4:16500:x1874405268498176:12345-0@lo:104: 00010000:00010000:1.0:1787572586.159306:0:14368:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.159343:0:14368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787572586.159348:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39be3db9-5eba-42e2-9087-a4df3ec904cb+4:16500:x1874405268498176:12345-0@lo:104: Request processed in 51us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572586.159355:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787572586.159367:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787572586.159382:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1d5df4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:16500:x1874405268498304:12345-0@lo:104: 00010000:00010000:1.0:1787572586.159390:0:14368:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572586.163332:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6249f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268498048:0@lo:104: 00000100:00100000:3.0:1787572586.163353:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268498176:0@lo:104: 00010000:00010000:1.0:1787572586.169323:0:14368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787572586.169350:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1d5df4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39be3db9-5eba-42e2-9087-a4df3ec904cb+3:16500:x1874405268498304:12345-0@lo:104: Request processed in 9961us (10281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572586.169365:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787572586.169447:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787572586.169456:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.169467:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463600 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572586.169473:0:15598:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.169483:0:15598:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572586.169491:0:15598:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572586.169496:0:15598:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787572586.169529:0:14372:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787572586.169537:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.169546:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c0030e00 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:2.0:1787572586.169550:0:14372:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.169552:0:15598:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.169565:0:14372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.169566:0:15598:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1787572586.169576:0:14372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787572586.169584:0:14372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787572586.169605:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.169621:0:14372:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.169631:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437597 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f43759e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.169651:0:14372:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787572586.169677:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787572586.169681:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.169687:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277000 already unused, calling callback (ffffffffc1c36c20) 10000000:00010000:1.0:1787572586.169690:0:15598:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.169697:0:15598:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787572586.169703:0:15598:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572586.169709:0:15598:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787572586.169723:0:15598:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.169730:0:15598:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787572586.169823:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268498304:0@lo:104: 00010000:00010000:1.0:1787572586.170380:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.170390:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1fc277000/0x9fe530ef4f43740f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f437416 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.170403:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572586.170414:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787572586.170416:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572586.170437:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39be3db9-5eba-42e2-9087-a4df3ec904cb:3313:1874405268498432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572586.170502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572586.170623:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268498688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572586.170673:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787572586.170745:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572586.174652:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.174672:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff98d1c0030e00/0x9fe530ef4f43745c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9fe530ef4f437463 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.174701:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572586.174704:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572586.174707:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572586.174739:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268498560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787572586.176752:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572586.177179:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268498432 00000100:00100000:3.0:1787572586.177190:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268498432 00010000:00010000:3.0:1787572586.177257:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 19 pid: 14376 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572586.177305:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268498688 00000100:00100000:3.0:1787572586.177310:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268498688 00010000:00010000:3.0:1787572586.177323:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 20 pid: 14378 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572586.177337:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787572586.177369:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+20:3313:x1874405268498432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787572586.177384:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572586.177391:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 20 pid: 14376 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.177401:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 20 pid: 14376 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.177422:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0eae00/0x9fe530ef4f43759e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f437597 expref: 20 pid: 14376 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.177437:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572586.177503:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3313:x1874405268498432:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (7000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572586.177510:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787572586.177531:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787572586.177537:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:3311:x1874405268498688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787572586.177544:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787572586.177548:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 18 pid: 14378 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.177556:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 18 pid: 14378 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.177566:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43740f expref: 18 pid: 14378 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572586.177574:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787572586.177600:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:3311:x1874405268498688:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (6927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572586.177614:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787572586.177791:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39be3db9-5eba-42e2-9087-a4df3ec904cb:3313:1874405268498432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572586.177825:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268498688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787572586.183049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572586.183283:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268497792:192.168.204.55@tcp:104: 00000100:00100000:3.0:1787572586.183411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572586.183513:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16500:1874405268497920:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572586.183557:0:16500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572586.189438:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244387840 00000100:00100000:1.0:1787572586.189440:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244387968 00000100:00100000:2.0:1787572586.189457:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244387840 00000100:00100000:1.0:1787572586.189457:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244387968 00010000:00010000:2.0:1787572586.189524:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 14 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572586.189565:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268498560 00000100:00100000:2.0:1787572586.189569:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268498560 00010000:00010000:2.0:1787572586.189589:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 17 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572586.189607:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00010000:00010000:0.0:1787572586.189618:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 14 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572586.189622:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+14:2354:x1874405244387840:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572586.189659:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572586.189667:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 14 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.189703:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 14 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.189724:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f4376f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdc5 expref: 14 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.189741:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572586.189826:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:2354:x1874405244387840:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 208us (6791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572586.189834:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:2.0:1787572586.189856:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787572586.189863:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1cdfea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:3310:x1874405268498560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787572586.189874:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787572586.189879:0:14370:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787572586.189879:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 17 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.189893:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 17 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572586.189896:0:14370:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787572586.189908:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1de0eb200/0x9fe530ef4f437463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9fe530ef4f43745c expref: 17 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572586.189917:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572586.190386:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1cdfea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3310:x1874405268498560:12345-0@lo:103:ldlm_bl.0 Request processed in 523us (13642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572586.190393:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787572586.191177:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268498560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787572586.191773:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1787572586.191790:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6248380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:2354:x1874405244387968:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572586.191808:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572586.191817:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 12 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.191831:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 12 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.191850:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1f4671200/0x9fe530ef4f4376bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd63 expref: 12 pid: 14379 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.191887:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.191896:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.191912:0:14369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.191920:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.192004:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.192011:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.192017:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671600 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572586.192022:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.192030:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.192049:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.192060:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572586.192250:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6248380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:2354:x1874405244387968:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 466us (8837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572586.192265:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00010000:00010000:1.0:1787572586.192307:0:16500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.192315:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.192322:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d1f4671600/0x9fe530ef4f43771f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572586.354683:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572586.479142:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787572586.479171:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268498816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572586.479258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572586.479478:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268498816 00000100:00100000:2.0:1787572586.479498:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268498816 00000100:00100000:2.0:1787572586.479567:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787572586.479578:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268498816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787572586.479615:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572586.479763:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874405268498816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572586.479770:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787572586.479938:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787572586.479982:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874405268498816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787572586.991167:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787572586.991720:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268499328:0@lo:400:kworker.0 00000100:00100000:2.0:1787572586.991803:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572586.991863:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268498944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572586.991888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572586.991913:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268499072:0@lo:400:kworker.0 00000100:00100000:2.0:1787572586.991920:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268498944 00000100:00100000:2.0:1787572586.991927:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268498944 00000100:00100000:3.0:1787572586.991947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572586.991971:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572586.991977:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268499200:0@lo:400:kworker.0 00000100:00100000:2.0:1787572586.991989:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787572586.991998:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572586.992023:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268499072 00000100:00100000:3.0:1787572586.992027:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268499072 00000100:00100000:0.0:1787572586.992122:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268499328 00000100:00100000:0.0:1787572586.992127:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268499328 00000100:00100000:0.0:1787572586.992158:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268499200 00000100:00100000:0.0:1787572586.992160:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268499200 00000100:00100000:0.0:1787572586.992176:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787572586.992184:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268499328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572586.992252:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268499328:12345-0@lo:400:kworker.0 Request processed in 69us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572586.992259:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787572586.992278:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787572586.992284:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268499200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787572586.992316:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874405268499200:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572586.992322:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787572586.992366:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268499200:0@lo:400:kworker.0 00000100:00100000:0.0:1787572586.992394:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268499328:0@lo:400:kworker.0 00000100:00100000:3.0:1787572586.992504:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787572586.992511:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3310:x1874405268499072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787572586.992543:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:3310:x1874405268499072:12345-0@lo:400:kworker.0 Request processed in 32us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572586.992548:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787572586.992553:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268498944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572586.992579:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572586.992708:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268498944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572586.992716:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787572586.992733:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572586.992734:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39be3db9-5eba-42e2-9087-a4df3ec904cb:3310:1874405268499072:0@lo:400:kworker.0 00000100:00100000:1.0:1787572586.992924:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268499712:0@lo:400:kworker.0 00000100:00100000:1.0:1787572586.992961:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572586.992982:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787572586.992987:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268499584:0@lo:400:kworker.0 00000100:00100000:1.0:1787572586.993005:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572586.993168:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268499456:0@lo:400:kworker.0 00000100:00100000:0.0:1787572586.993197:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572586.993494:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268499712 00000100:00100000:1.0:1787572586.993500:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268499712 00000100:00100000:1.0:1787572586.993543:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268499584 00000100:00100000:1.0:1787572586.993546:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268499584 00000100:00100000:1.0:1787572586.993566:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268499456 00000100:00100000:1.0:1787572586.993568:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268499456 00000100:00100000:1.0:1787572586.993580:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787572586.993586:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268499712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572586.993627:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268499712:12345-0@lo:400:kworker.0 Request processed in 41us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572586.993657:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787572586.993673:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787572586.993688:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268499584:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787572586.993702:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572586.993719:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874405268499584:12345-0@lo:400:kworker.0 Request processed in 32us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572586.993726:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787572586.993737:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787572586.993743:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268499456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572586.993780:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268499456:12345-0@lo:400:kworker.0 Request processed in 37us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572586.993785:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787572586.993818:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874405268499584:0@lo:400:kworker.0 00000100:00100000:1.0:1787572586.993827:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268499712:0@lo:400:kworker.0 00000100:00100000:3.0:1787572586.993922:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268498944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787572586.997380:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268499456:0@lo:400:kworker.0 00010000:00010000:2.0:1787572587.375756:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572587.583324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572587.583767:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244388096 00000100:00100000:3.0:1787572587.583783:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244388096 00000100:00100000:3.0:1787572587.583942:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:3.0:1787572587.583955:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f43b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+11:13766:x1874405244388096:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572587.583972:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572587.583991:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbdf6 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.584018:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdf6 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.584029:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670000/0x9fe530ef4f437726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdf6 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.584039:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670000, rc 0) 00000100:00100000:3.0:1787572587.584093:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f43b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13766:x1874405244388096:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 142us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.587480:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:1.0:1787572587.592804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572587.592967:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244388224 00000100:00100000:3.0:1787572587.592977:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244388224 00000100:00100000:3.0:1787572587.593039:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 107 00000100:00100000:3.0:1787572587.593049:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13766:x1874405244388224:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572587.593328:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13766:x1874405244388224:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 279us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.593336:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 107 00000100:00100000:2.0:1787572587.602573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572587.602622:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244388352 00000100:00100000:2.0:1787572587.602656:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244388352 00000100:00100000:2.0:1787572587.602727:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:2.0:1787572587.602886:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13766:x1874405244388352:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787572587.603112:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13766:x1874405244388352:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 230us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572587.603120:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:3.0:1787572587.623394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572587.624886:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244388480 00000100:00100000:3.0:1787572587.624911:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244388480 00000100:00100000:3.0:1787572587.625003:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:3.0:1787572587.625016:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+12:13766:x1874405244388480:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572587.625033:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572587.625052:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4671000/0x9fe530ef4f43772d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf566153e151dbdfd expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.625080:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671000/0x9fe530ef4f43772d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdfd expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.625091:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4671000/0x9fe530ef4f43772d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdfd expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.625102:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671000, rc 0) 00000100:00100000:3.0:1787572587.625173:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13766:x1874405244388480:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.625181:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:3.0:1787572587.636320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572587.636364:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244388608 00000100:00100000:3.0:1787572587.636375:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244388608 00000100:00100000:3.0:1787572587.636428:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:3.0:1787572587.636438:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13766:x1874405244388608:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572587.637372:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13766:x1874405244388608:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 931us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.637384:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:2.0:1787572587.643105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572587.644212:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244388736 00000100:00100000:1.0:1787572587.644229:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244388736 00000100:00100000:1.0:1787572587.644300:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 111 00000100:00100000:1.0:1787572587.644313:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13766:x1874405244388736:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.644550:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:13766:x1874405244388736:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 239us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572587.644558:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 111 00000040:00080000:2.0:1787572587.828708:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787572587.886758:0:14381:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787572587.886770:0:14381:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d0c6271000 from 10 10000000:01000000:0.0:1787572587.886776:0:14381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787572587.886836:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f437734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572587.886848:0:14381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f437734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572587.886860:0:14381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f437734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572587.886888:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268499840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787572587.886964:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572587.887032:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787572587.887147:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268499840 00000100:00100000:3.0:1787572587.887154:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268499840 00000100:00100000:3.0:1787572587.887222:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787572587.887250:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c10c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+16:14381:x1874405268499840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572587.887267:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572587.887282:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f43773b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437734 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.887313:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f43773b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437734 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.887326:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4671400/0x9fe530ef4f43773b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437734 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.887338:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671400, rc 0) 00000100:00100000:3.0:1787572587.887392:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c10c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:14381:x1874405268499840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.887400:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787572587.887594:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268499840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787572587.887609:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f437734 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43773b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572587.887619:0:14381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f437734 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f43773b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572587.887707:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268499968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572587.887735:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787572587.887761:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787572587.887874:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268499968 00000100:00100000:3.0:1787572587.887879:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268499968 00000100:00100000:3.0:1787572587.887913:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787572587.887920:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:14381:x1874405268499968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572587.888221:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:14381:x1874405268499968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.888230:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787572587.890768:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268499968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.890856:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f447bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.890961:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572587.891080:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787572587.898089:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268500096 00000100:00100000:3.0:1787572587.898108:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268500096 00000100:00100000:3.0:1787572587.898179:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787572587.898201:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:14381:x1874405268500096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572587.898654:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:14381:x1874405268500096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (7518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.898671:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787572587.898787:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f447bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787572587.899921:0:16569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787572587.900111:0:14381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787572587.900165:0:14381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787572587.900177:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f437734 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43773b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572587.900198:0:14381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1d0a31c00/0x9fe530ef4f437734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f43773b expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572587.900214:0:14381:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787572587.900217:0:14381:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d0c52f5800 from 10 10000000:01000000:1.0:1787572587.900220:0:14381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787572587.900263:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572587.900271:0:14381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572587.900291:0:14381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572587.900320:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.900385:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572587.900454:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787572587.900686:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268500224 00000100:00100000:3.0:1787572587.900694:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268500224 00000100:00100000:3.0:1787572587.900745:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787572587.900762:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+17:14381:x1874405268500224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572587.900776:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572587.900788:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f437749 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437742 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.900819:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f437749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437742 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.900828:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4671e00/0x9fe530ef4f437749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437742 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.900842:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4671e00, rc 0) 00000100:00100000:3.0:1787572587.900891:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:14381:x1874405268500224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.900897:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787572587.900952:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4478000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572587.900974:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437749 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.900983:0:14381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437749 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572587.901045:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572587.901102:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572587.901126:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1fbeb3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787572587.901147:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268500352 00000100:00100000:3.0:1787572587.901151:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268500352 00000100:00100000:3.0:1787572587.901174:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787572587.901198:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:14381:x1874405268500352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572587.903691:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:14381:x1874405268500352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2499us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.903706:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787572587.906679:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c6248700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.906759:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.906850:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572587.906897:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787572587.906925:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268500480 00000100:00100000:1.0:1787572587.906932:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268500480 00000100:00100000:1.0:1787572587.906978:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787572587.906996:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:14381:x1874405268500480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.907207:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:14381:x1874405268500480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572587.907215:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787572587.907269:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787572587.908128:0:16570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787572587.908253:0:14381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787572587.908274:0:14381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787572587.908286:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437742 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437749 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572587.908298:0:14381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1463600/0x9fe530ef4f437742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437749 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787572587.908310:0:14381:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787572587.908313:0:14381:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d1f4534000 from 10 10000000:01000000:1.0:1787572587.908316:0:14381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787572587.908351:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f437750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572587.908360:0:14381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f437750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572587.908370:0:14381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f437750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572587.908388:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.908431:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572587.909001:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268500608 00000100:00100000:3.0:1787572587.909009:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268500608 00000100:00100000:3.0:1787572587.909049:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787572587.909067:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+18:14381:x1874405268500608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787572587.909082:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572587.909099:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f437757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9fe530ef4f437750 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.909130:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f437757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9fe530ef4f437750 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.909140:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d1f4670200/0x9fe530ef4f437757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9fe530ef4f437750 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572587.909149:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1f4670200, rc 0) 00000100:00100000:3.0:1787572587.909198:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:14381:x1874405268500608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572587.909205:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787572587.910014:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572587.910041:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787572587.910066:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f437750 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437757 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572587.910081:0:14381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f437750 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9fe530ef4f437757 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572587.910153:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787572587.910208:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572587.910246:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c6fa03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572587.910341:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268500736 00000100:00100000:0.0:1787572587.910347:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268500736 00000100:00100000:0.0:1787572587.910403:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787572587.910421:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:14381:x1874405268500736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787572587.910773:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:14381:x1874405268500736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572587.910788:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787572587.911063:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4479c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787572587.911117:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787572587.911155:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572587.911208:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1c5b31000 going to sleep for 11 seconds 00000100:00100000:0.0:1787572587.911268:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268500864 00000100:00100000:0.0:1787572587.911274:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268500864 00000100:00100000:0.0:1787572587.911302:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787572587.911319:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:14381:x1874405268500864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787572587.911467:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:14381:x1874405268500864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572587.911523:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787572587.911594:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c624b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39be3db9-5eba-42e2-9087-a4df3ec904cb:14381:1874405268500864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787572587.914108:0:16571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787572587.916450:0:14381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787572587.916585:0:14381:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787572587.916597:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f437750 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437757 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572587.916610:0:14381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff98d1c1462a00/0x9fe530ef4f437750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9fe530ef4f437757 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572588.399778:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572589.376139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572589.378853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572589.379486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572589.379515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572589.381780:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244389120 00000100:00100000:3.0:1787572589.381795:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244389120 00000100:00100000:3.0:1787572589.381887:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:3.0:1787572589.381900:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244389120:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572589.381979:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244389120:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 83us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572589.381987:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:3.0:1787572589.383542:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787572589.384456:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244388864 00000100:00100000:1.0:1787572589.384468:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244388864 00000100:00100000:1.0:1787572589.384526:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:1.0:1787572589.384538:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:2354:x1874405244388864:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572589.384624:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:2354:x1874405244388864:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 88us (5781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572589.384646:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:2.0:1787572589.393572:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244388992 00000100:00100000:1.0:1787572589.393587:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244389376 00000100:00100000:2.0:1787572589.393592:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244388992 00000100:00100000:1.0:1787572589.393595:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244389376 00000100:00100000:0.0:1787572589.393668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572589.393690:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:0.0:1787572589.393699:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244389632 00000100:00100000:1.0:1787572589.393704:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2354:x1874405244389376:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572589.393705:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244389632 00000100:00100000:2.0:1787572589.393707:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:2.0:1787572589.393722:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+6:2353:x1874405244388992:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572589.393750:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1787572589.393769:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244389632:12345-192.168.204.55@tcp:400:kworker.0 00000100:00080000:3.0:1787572589.393834:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787572589.393839:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572589.395408:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2354:x1874405244389376:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 1700us (15882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572589.395421:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:2.0:1787572589.399040:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+6:2353:x1874405244388992:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 5306us (22898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572589.399060:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:0.0:1787572589.406044:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244389632:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 12268us (12366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572589.406062:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:1.0:1787572589.409054:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572589.409150:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572589.415197:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244389248 00000100:00100000:3.0:1787572589.415219:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244389248 00000100:00100000:3.0:1787572589.415533:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244389504 00000100:00100000:3.0:1787572589.415538:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244389504 00000100:00100000:3.0:1787572589.415580:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1787572589.415591:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14621f29-0314-45be-9667-d365740545a2+5:2353:x1874405244389248:12345-192.168.204.55@tcp:400:kworker.0 00000100:00080000:0.0:1787572589.415712:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787572589.415717:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787572589.416044:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787572589.416056:0:15067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787572589.416215:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14621f29-0314-45be-9667-d365740545a2+5:2353:x1874405244389248:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 624us (7170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572589.416225:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1787572589.417079:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1787572589.417094:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2353:x1874405244389504:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572589.417185:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2353:x1874405244389504:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 95us (8034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572589.417192:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00010000:00010000:1.0:1787572589.423188:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787572589.864794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572589.866662:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244389760 00000100:00100000:0.0:1787572589.866679:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244389760 00000100:00100000:0.0:1787572589.866782:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:0.0:1787572589.866794:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+6:14426:x1874405244389760:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572589.866815:0:16006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572589.866835:0:16006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f43775e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe04 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.866904:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.866919:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.866931:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.866945:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.866951:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.866957:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867490:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31e00/0x9fe530ef4f437773 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867500:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31e00/0x9fe530ef4f437773 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867507:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31e00/0x9fe530ef4f437773 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572589.867602:0:16006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787572589.867606:0:16006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572589.867737:0:16006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31e00/0x9fe530ef4f437773 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867750:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867756:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867763:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867768:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572589.867772:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867779:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867793:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149900) 00010000:00010000:0.0:1787572589.867795:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572589.867799:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867805:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867818:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867832:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867838:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867843:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572589.867847:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867853:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867861:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98d1d0149a00) 00010000:00010000:0.0:1787572589.867863:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572589.867866:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867872:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f43776c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867908:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f43775e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe04 expref: 8 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867922:0:16006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31e00/0x9fe530ef4f437773 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe04 expref: 7 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.867931:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d1d0149c00) 00010000:00010000:0.0:1787572589.867933:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572589.867941:0:16006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a31e00, rc 0) 00000100:00100000:0.0:1787572589.868039:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+7:14426:x1874405244389760:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1247us (3258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572589.868046:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1787572589.871794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572589.871884:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244390016 00000100:00100000:3.0:1787572589.871893:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244390016 00000100:00100000:3.0:1787572589.871956:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:3.0:1787572589.871966:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+7:14426:x1874405244390016:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572589.871988:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572589.872009:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671600/0x9fe530ef4f43777a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe0b expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872101:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872117:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872129:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872157:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872165:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872171:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872771:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8600/0x9fe530ef4f43778f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872789:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8600/0x9fe530ef4f43778f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.872797:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8600/0x9fe530ef4f43778f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572589.872808:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787572589.873100:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873109:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873117:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873123:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1f4671200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572589.873127:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873135:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873164:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d1d0149c00) 00010000:00010000:3.0:1787572589.873168:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572589.873173:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873179:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671200/0x9fe530ef4f437781 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873191:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873205:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873211:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873215:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c8000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572589.873218:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873223:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873231:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98d1e1353200) 00010000:00010000:3.0:1787572589.873233:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572589.873236:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873241:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437788 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873681:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671600/0x9fe530ef4f43777a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe0b expref: 10 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873698:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8600/0x9fe530ef4f43778f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe0b expref: 9 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.873705:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1e1353600) 00010000:00010000:3.0:1787572589.873707:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572589.873715:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8600, rc 0) 00000100:00100000:3.0:1787572589.873792:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+9:14426:x1874405244390016:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1827us (2008us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787572589.873802:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:1.0:1787572589.879567:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572589.879726:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244390144 00000100:00100000:2.0:1787572589.879753:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244390144 00000100:00100000:2.0:1787572589.879835:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1787572589.879848:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+9:14426:x1874405244390144:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787572589.879968:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+9:14426:x1874405244390144:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 Request processed in 123us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572589.879976:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1787572589.973095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572589.973193:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244390272 00000100:00100000:3.0:1787572589.973205:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244390272 00000100:00100000:3.0:1787572589.973273:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:3.0:1787572589.973284:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+9:14432:x1874405244390272:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1787572589.973308:0:15089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572589.973332:0:15089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f43779d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe12 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973401:0:15089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973415:0:15089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973446:0:15089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973463:0:15089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973471:0:15089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973477:0:15089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973788:0:15089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973803:0:15089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973810:0:15089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973816:0:15089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572589.973821:0:15089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973828:0:15089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973841:0:15089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149900) 00010000:00010000:3.0:1787572589.973844:0:15089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572589.973849:0:15089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973855:0:15089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4377a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973867:0:15089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973873:0:15089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973879:0:15089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973884:0:15089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c8a00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572589.973894:0:15089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973901:0:15089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973909:0:15089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d1e1353200) 00010000:00010000:3.0:1787572589.973911:0:15089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572589.973914:0:15089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973919:0:15089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f4377ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973956:0:15089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f43779d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe12 expref: 10 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973966:0:15089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149900) 00010000:00010000:3.0:1787572589.973968:0:15089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572589.973983:0:15089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f43779d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe12 expref: 10 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572589.973994:0:15089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8000, rc 0) 00000100:00100000:3.0:1787572589.974066:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+9:14432:x1874405244390272:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 783us (986us total) trans 0 rc 301/301 00000100:00100000:3.0:1787572589.974074:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:1.0:1787572589.981330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572589.981461:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244390400 00000100:00100000:2.0:1787572589.981472:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244390400 00000100:00100000:2.0:1787572589.981530:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:2.0:1787572589.981540:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:14621f29-0314-45be-9667-d365740545a2+9:14432:x1874405244390400:12345-192.168.204.55@tcp:700:lfs.0 00000100:00100000:2.0:1787572589.981627:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:14621f29-0314-45be-9667-d365740545a2+9:14432:x1874405244390400:12345-192.168.204.55@tcp:700:lfs.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572589.981661:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:2.0:1787572589.984617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572589.989911:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244390656 00000100:00100000:1.0:1787572589.989936:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244390656 00000100:00100000:1.0:1787572589.990031:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:1.0:1787572589.990043:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+9:14432:x1874405244390656:12345-192.168.204.55@tcp:36:lfs.0 00010000:00010000:1.0:1787572589.990104:0:14384:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572589.990134:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30400/0x9fe530ef4f4376e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbd8d expref: 9 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.990170:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149900) 00010000:00010000:1.0:1787572589.990175:0:14384:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572589.990930:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.990951:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 5 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.990961:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.991168:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 5 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.991195:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 5 pid: 14385 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572589.991215:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874405268500992:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572589.991342:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787572589.994277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572589.994397:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874405268500992:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572589.994430:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572589.994902:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244390784 00000100:00100000:0.0:1787572589.994910:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244390784 00010000:00010000:0.0:1787572589.994954:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 6 pid: 14385 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572589.994993:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:0.0:1787572589.995004:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c624b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2354:x1874405244390784:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572589.995018:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572589.995026:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 6 pid: 14385 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.995038:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 6 pid: 14385 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.995059:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1f4671800/0x9fe530ef4f437718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbdef expref: 6 pid: 14385 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.995073:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149900) 00010000:00010000:0.0:1787572589.995078:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.995085:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.995092:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572589.995134:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572589.995201:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c624b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244390784:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 198us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572589.995210:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00010000:00010000:1.0:1787572589.995340:0:14384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.995348:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.995375:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.995384:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.995392:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572589.996703:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787572589.996721:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.996732:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.996746:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.996752:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572589.996757:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.996765:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.996780:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149900) 00010000:00010000:1.0:1787572589.996783:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572589.996787:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572589.996793:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572589.996814:0:14384:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000682126c6 reply state 0000000087fa956a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572589.996823:0:14384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787572589.996913:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+10:14432:x1874405244390656:12345-192.168.204.55@tcp:36:lfs.0 Request processed in 6869us (12316us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787572589.996923:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00010000:00010000:0.0:1787572590.000209:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.000227:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.000236:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.000242:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572590.000246:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.000255:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.000271:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d1d0b0b500) 00010000:00010000:0.0:1787572590.000275:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572590.000280:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.000286:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377b9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572590.078673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572590.082014:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244390912 00000100:00100000:0.0:1787572590.082031:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244390912 00000100:00100000:0.0:1787572590.082205:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:0.0:1787572590.082218:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+9:14440:x1874405244390912:12345-192.168.204.55@tcp:101:lctl.0 00010000:00010000:0.0:1787572590.082244:0:16006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572590.082267:0:16006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f4377c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe19 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.082337:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f4377c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.082351:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f4377c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.082362:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f4377c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572590.082428:0:16006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787572590.082432:0:16006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572590.082483:0:16006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f4377c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.082523:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f4377c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe19 expref: 11 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.082542:0:16006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a31400/0x9fe530ef4f4377c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe19 expref: 10 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.082551:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149a00) 00010000:00010000:0.0:1787572590.082553:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572590.082558:0:16006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a31400, rc 0) 00000100:00100000:0.0:1787572590.083793:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+10:14440:x1874405244390912:12345-192.168.204.55@tcp:101:lctl.0 Request processed in 1572us (5123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572590.083816:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:3.0:1787572590.113115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.113600:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244391040 00000100:00100000:1.0:1787572590.113611:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244391040 00000100:00100000:1.0:1787572590.113713:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:1.0:1787572590.113725:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:14441:x1874405244391040:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572590.113759:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572590.113779:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe20 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.113852:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f4377d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.113867:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f4377d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.113879:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f4377d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572590.113940:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787572590.113944:0:14385:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572590.113968:0:14385:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f4377d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.113993:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463e00/0x9fe530ef4f4377ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe20 expref: 7 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.114011:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462e00/0x9fe530ef4f4377d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe20 expref: 6 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.114020:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149a00) 00010000:00010000:1.0:1787572590.114023:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572590.114026:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c1462e00, rc 0) 00000100:00100000:1.0:1787572590.114094:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:14441:x1874405244391040:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 371us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572590.114101:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:3.0:1787572590.119779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.119866:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244391168 00000100:00100000:1.0:1787572590.119878:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244391168 00000100:00100000:1.0:1787572590.119946:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:1.0:1787572590.119957:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:14441:x1874405244391168:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572590.119981:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572590.120004:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe27 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120072:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120089:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120102:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120119:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120126:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120134:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120255:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4377f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120264:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4377f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120284:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4377f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572590.120328:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787572590.120331:0:14384:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572590.120356:0:14384:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4377f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120368:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120374:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120381:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120387:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1462c00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572590.120391:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120398:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120411:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149a00) 00010000:00010000:1.0:1787572590.120414:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572590.120418:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120424:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462c00/0x9fe530ef4f4377e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120459:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120464:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120469:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120474:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c1463800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572590.120477:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120483:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120490:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d1d0b0b000) 00010000:00010000:1.0:1787572590.120492:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572590.120495:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120500:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1463800/0x9fe530ef4f4377ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120531:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c1462200/0x9fe530ef4f4377dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe27 expref: 8 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120545:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4377f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe27 expref: 7 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.120577:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572590.120580:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787572590.120583:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb200, rc 0) 00000100:00100000:1.0:1787572590.120675:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+7:14441:x1874405244391168:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 720us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572590.120683:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:3.0:1787572590.126095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572590.126198:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244391424 00000100:00100000:0.0:1787572590.126209:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244391424 00000100:00100000:0.0:1787572590.126282:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:0.0:1787572590.126294:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+7:14441:x1874405244391424:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572590.126316:0:16006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572590.126336:0:16006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f4377f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe2e expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572590.126475:0:16006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787572590.126601:0:16006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f4377f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe2e expref: 9 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.126615:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149a00) 00010000:00010000:0.0:1787572590.126618:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787572590.126623:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f4377f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe2e expref: 9 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.126930:0:16006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30800, rc 0) 00000100:00100000:0.0:1787572590.127165:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+8:14441:x1874405244391424:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 872us (1078us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787572590.127174:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:3.0:1787572590.132009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.133593:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244391680 00000100:00100000:1.0:1787572590.133605:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244391680 00000100:00100000:1.0:1787572590.133703:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:1.0:1787572590.133714:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+8:14441:x1874405244391680:12345-192.168.204.55@tcp:36:lfs.0 00010000:00010000:1.0:1787572590.133768:0:14385:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572590.133796:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f4377f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe27 expref: 8 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.133814:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572590.133824:0:14385:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572590.133846:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.133859:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.133868:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572590.134109:0:14385:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e2a8895 reply state 0000000076de7f40 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572590.134136:0:14385:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787572590.134164:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787572590.134259:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+9:14441:x1874405244391680:12345-192.168.204.55@tcp:36:lfs.0 Request processed in 546us (2259us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787572590.134267:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:3.0:1787572590.137275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572590.137610:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244391936 00000100:00100000:0.0:1787572590.137621:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244391936 00000100:00100000:0.0:1787572590.137701:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1787572590.137713:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+9:14441:x1874405244391936:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572590.138001:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+10:14441:x1874405244391936:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 290us (735us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787572590.138010:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00010000:00010000:1.0:1787572590.140257:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.140276:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.140283:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.140289:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eae00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572590.140294:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.140302:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.140320:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:1.0:1787572590.140323:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787572590.140327:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.140333:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f437806 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572590.146485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.146552:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244392192 00000100:00100000:1.0:1787572590.146576:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244392192 00000100:00100000:1.0:1787572590.146715:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:1.0:1787572590.146725:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+9:14441:x1874405244392192:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1787572590.146750:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572590.146767:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43780d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe35 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.146838:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.146852:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.146863:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.146877:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.146883:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.146889:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572590.147020:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787572590.147112:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147120:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147135:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147152:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572590.147156:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147164:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147176:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149a00) 00010000:00010000:1.0:1787572590.147179:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572590.147183:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147188:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147200:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147205:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147210:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147213:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572590.147215:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147228:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147234:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572590.147236:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572590.147238:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147243:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43781b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147283:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43780d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe35 expref: 11 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147294:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149a00) 00010000:00010000:1.0:1787572590.147296:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787572590.147300:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f43780d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe35 expref: 11 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.147310:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb600, rc 0) 00000100:00100000:1.0:1787572590.147377:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+10:14441:x1874405244392192:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 653us (901us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787572590.147383:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:3.0:1787572590.152769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572590.152869:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244392320 00000100:00100000:0.0:1787572590.152879:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244392320 00000100:00100000:0.0:1787572590.152946:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:0.0:1787572590.152958:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+10:14441:x1874405244392320:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1787572590.152983:0:16006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572590.153005:0:16006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f437829 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe3c expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.153095:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.153112:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.153125:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787572590.153198:0:16006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787572590.153203:0:16006:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787572590.153227:0:16006:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.153257:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30800/0x9fe530ef4f437829 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 12 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.153278:0:16006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 11 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.153301:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d1d0149500) 00010000:00010000:0.0:1787572590.153304:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787572590.153308:0:16006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30000, rc 0) 00000100:00100000:0.0:1787572590.153385:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+11:14441:x1874405244392320:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 430us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572590.153392:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:3.0:1787572590.162017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.162110:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244392448 00000100:00100000:1.0:1787572590.162122:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244392448 00000100:00100000:1.0:1787572590.162197:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:1.0:1787572590.162209:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+11:14441:x1874405244392448:12345-192.168.204.55@tcp:37:lfs.0 00000100:00100000:1.0:1787572590.167106:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+11:14441:x1874405244392448:12345-192.168.204.55@tcp:37:lfs.0 Request processed in 4887us (5087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572590.167120:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:3.0:1787572590.176855:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572590.181226:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244392704 00000100:00100000:0.0:1787572590.181241:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244392704 00000100:00100000:0.0:1787572590.181315:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:0.0:1787572590.181329:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c3d6b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+11:14441:x1874405244392704:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572590.182342:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c3d6b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+12:14441:x1874405244392704:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 1013us (5492us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787572590.182353:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:3.0:1787572590.275952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.276166:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244392832 00000100:00100000:1.0:1787572590.276177:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244392832 00000100:00100000:1.0:1787572590.276238:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:1.0:1787572590.276247:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+10:14447:x1874405244392832:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1787572590.276267:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572590.276284:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe43 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276343:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276423:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276437:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276451:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276458:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276465:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276686:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f43784c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276714:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f43784c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276722:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f43784c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572590.276765:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787572590.276769:0:14385:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572590.276914:0:14385:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f43784c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276926:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276933:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276940:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276945:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572590.276949:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276956:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276969:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149a00) 00010000:00010000:1.0:1787572590.276971:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572590.276976:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.276991:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f43783e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277004:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277009:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277015:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277021:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572590.277196:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277204:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277212:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d1d0b0b500) 00010000:00010000:1.0:1787572590.277215:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572590.277218:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277224:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f437845 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277255:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe43 expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277278:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eae00/0x9fe530ef4f43784c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe43 expref: 11 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.277285:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d1d0149500) 00010000:00010000:1.0:1787572590.277287:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787572590.277289:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eae00, rc 0) 00000100:00100000:1.0:1787572590.277452:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+11:14447:x1874405244392832:12345-192.168.204.55@tcp:101:bash.0 Request processed in 1205us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572590.277460:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:2.0:1787572590.286539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.286616:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244393088 00000100:00100000:1.0:1787572590.286627:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244393088 00000100:00100000:1.0:1787572590.286724:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:1.0:1787572590.286734:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+11:14447:x1874405244393088:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1787572590.286757:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572590.286778:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437853 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe4a expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.286921:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.286939:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 11 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.286948:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.286983:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 11 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.287010:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 11 pid: 16006 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572590.287024:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874405268501120:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572590.287128:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada000 going to sleep for 11 seconds 00000100:00100000:3.0:1787572590.293189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.294927:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874405268501120:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572590.294959:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572590.295817:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244393216 00000100:00100000:2.0:1787572590.295826:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244393216 00010000:00010000:2.0:1787572590.295873:0:14370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 12 pid: 16006 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572590.295975:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:2.0:1787572590.295985:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c6ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+12:2354:x1874405244393216:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572590.296003:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572590.296011:0:14370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 12 pid: 16006 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.296043:0:14370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 12 pid: 16006 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.296066:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30000/0x9fe530ef4f437830 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe3c expref: 12 pid: 16006 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.296087:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d1d0149500) 00010000:00010000:2.0:1787572590.296093:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.296102:0:14370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.296110:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.296195:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787572590.296260:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c6ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+11:2354:x1874405244393216:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 275us (3083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572590.296268:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00010000:00010000:1.0:1787572590.297237:0:14384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.297248:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.297275:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.297286:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.297295:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.298291:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.298304:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.298319:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572590.298331:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787572590.298360:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.299122:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.299131:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.299147:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572590.299151:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.299159:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.299172:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d1d0149500) 00010000:00010000:1.0:1787572590.299176:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572590.299180:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.299186:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebe00/0x9fe530ef4f43785a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572590.299200:0:14384:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4cd0c31 reply state 0000000096a676a8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572590.299224:0:14384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787572590.299267:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb600/0x9fe530ef4f437853 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 14 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.299282:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 13 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.299289:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:1.0:1787572590.299291:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787572590.299294:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb200, rc 0) 00000100:00100000:1.0:1787572590.299498:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+14:14447:x1874405244393088:12345-192.168.204.55@tcp:101:bash.0 Request processed in 12742us (12954us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787572590.299507:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00010000:00010000:0.0:1787572590.307395:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.307415:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.307424:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.307430:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:0.0:1787572590.307435:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.307444:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.307493:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98d1d0b0b500) 00010000:00010000:0.0:1787572590.307497:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787572590.307502:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.307509:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea200/0x9fe530ef4f437861 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572590.317110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572590.317397:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244393344 00000100:00100000:3.0:1787572590.317408:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244393344 00000100:00100000:3.0:1787572590.317471:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:3.0:1787572590.317490:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+13:14447:x1874405244393344:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1787572590.317524:0:15089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572590.317544:0:15089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437876 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe51 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.317623:0:15089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.317657:0:15089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.317669:0:15089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572590.317708:0:15089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787572590.317712:0:15089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787572590.317734:0:15089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.317760:0:15089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.317786:0:15089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f437876 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 15 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.317805:0:15089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 14 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.317814:0:15089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:3.0:1787572590.317816:0:15089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572590.317820:0:15089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8a00, rc 0) 00000100:00100000:3.0:1787572590.318176:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+14:14447:x1874405244393344:12345-192.168.204.55@tcp:101:bash.0 Request processed in 686us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572590.318184:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:1.0:1787572590.326240:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572590.326343:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244393600 00000100:00100000:3.0:1787572590.326353:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244393600 00000100:00100000:3.0:1787572590.326414:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1787572590.326426:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+14:14447:x1874405244393600:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:3.0:1787572590.326813:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+15:14447:x1874405244393600:12345-192.168.204.55@tcp:35:bash.0 Request processed in 389us (583us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787572590.326822:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:0.0:1787572590.439233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572590.441213:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244393856 00000100:00100000:2.0:1787572590.441230:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244393856 00000100:00100000:2.0:1787572590.441310:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:2.0:1787572590.441322:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+15:14457:x1874405244393856:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572590.441356:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572590.441392:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe58 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572590.441550:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787572590.441719:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437884 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe58 expref: 17 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.441734:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d1d0149a00) 00010000:00010000:2.0:1787572590.441737:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787572590.441741:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe58 expref: 17 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.441756:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277e00, rc 0) 00000100:00100000:2.0:1787572590.441834:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+16:14457:x1874405244393856:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 514us (2624us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787572590.441842:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 30 00010000:00010000:2.0:1787572590.447126:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787572590.450655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572590.451069:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244394112 00000100:00100000:0.0:1787572590.451079:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244394112 00000100:00100000:0.0:1787572590.451155:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1787572590.451167:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f452a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14621f29-0314-45be-9667-d365740545a2+16:14457:x1874405244394112:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1787572590.451901:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f452a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14621f29-0314-45be-9667-d365740545a2+17:14457:x1874405244394112:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 734us (1275us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787572590.451911:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:1.0:1787572590.537193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572590.537305:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244394368 00000100:00100000:2.0:1787572590.537316:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244394368 00000100:00100000:2.0:1787572590.537376:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:2.0:1787572590.537387:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+17:14460:x1874405244394368:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1787572590.537410:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572590.537432:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437892 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe5f expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.537532:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437899 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.537567:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.537580:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572590.537593:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787572590.537745:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277e00/0x9fe530ef4f437892 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe5f expref: 20 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.537764:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437899 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe5f expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572590.537774:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:2.0:1787572590.537777:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787572590.537780:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276400, rc 0) 00000100:00100000:2.0:1787572590.537934:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+19:14460:x1874405244394368:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 548us (752us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787572590.537942:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:3.0:1787572590.543005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.544058:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244394496 00000100:00100000:1.0:1787572590.544072:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244394496 00000100:00100000:1.0:1787572590.544197:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:1.0:1787572590.544210:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14621f29-0314-45be-9667-d365740545a2+19:2354:x1874405244394496:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572590.544228:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572590.544260:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276400/0x9fe530ef4f437899 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe5f expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572590.544283:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:1.0:1787572590.544290:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572590.544368:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14621f29-0314-45be-9667-d365740545a2+18:2354:x1874405244394496:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 160us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572590.544392:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1787572590.544859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572590.544885:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244394624 00000100:00100000:3.0:1787572590.544890:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244394624 00000100:00100000:3.0:1787572590.544927:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:3.0:1787572590.544948:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+18:14460:x1874405244394624:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:3.0:1787572590.545003:0:15089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545017:0:15089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545027:0:15089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545053:0:15089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545059:0:15089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545071:0:15089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545078:0:15089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c8000 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572590.545082:0:15089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545090:0:15089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545098:0:15089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:3.0:1787572590.545101:0:15089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787572590.545104:0:15089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.545119:0:15089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572590.545169:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+18:14460:x1874405244394624:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 222us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572590.545176:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:3.0:1787572590.554115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.554566:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244394880 00000100:00100000:1.0:1787572590.554586:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244394880 00000100:00100000:1.0:1787572590.554656:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:1.0:1787572590.554668:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+18:14460:x1874405244394880:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:1.0:1787572590.554936:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+19:14460:x1874405244394880:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 270us (829us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787572590.554943:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000040:00080000:2.0:1787572590.895299:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787572590.961962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572590.962110:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244395136 00000100:00100000:3.0:1787572590.962121:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244395136 00000100:00100000:3.0:1787572590.962196:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1787572590.962216:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+19:14491:x1874405244395136:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:3.0:1787572590.962254:0:16006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572590.962272:0:16006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe66 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.962379:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4378b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.962393:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4378b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.962406:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4378b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572590.962417:0:16006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787572590.962857:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe66 expref: 22 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.962897:0:16006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4378b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe66 expref: 21 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572590.962907:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:3.0:1787572590.962909:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787572590.962912:0:16006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c9600, rc 0) 00000100:00100000:3.0:1787572590.963112:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+21:14491:x1874405244395136:12345-192.168.204.55@tcp:101:cat.0 Request processed in 898us (1158us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787572590.963120:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:2.0:1787572590.973758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572590.973854:0:16502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244395264 00000100:00100000:0.0:1787572590.973865:0:16502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244395264 00000100:00100000:0.0:1787572590.973951:0:16502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1787572590.973963:0:16502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14621f29-0314-45be-9667-d365740545a2+21:2356:x1874405244395264:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787572590.973979:0:16502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572590.974004:0:16502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9600/0x9fe530ef4f4378b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe66 expref: 21 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572590.974023:0:16502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:0.0:1787572590.974042:0:16502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572590.974113:0:16502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14621f29-0314-45be-9667-d365740545a2+20:2356:x1874405244395264:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 152us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572590.974121:0:16502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:2.0:1787572590.975581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572590.975674:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244395520 00000100:00100000:1.0:1787572590.975685:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244395520 00000100:00100000:1.0:1787572590.975736:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1787572590.975748:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+20:14491:x1874405244395520:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:1.0:1787572590.976081:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+21:14491:x1874405244395520:12345-192.168.204.55@tcp:35:cat.0 Request processed in 334us (513us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787572590.976088:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:3.0:1787572591.066718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572591.066905:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244395776 00000100:00100000:2.0:1787572591.066916:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244395776 00000100:00100000:2.0:1787572591.066994:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:2.0:1787572591.067006:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+21:14497:x1874405244395776:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:2.0:1787572591.067032:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572591.067060:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe6d expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.067172:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.067188:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 22 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.067197:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 22 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.067319:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.067355:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 22 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.067369:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 22 pid: 15089 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572591.067383:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874405268501248:192.168.204.55@tcp:104: 00010000:00010000:2.0:1787572591.067556:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 22 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.067566:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 22 pid: 14384 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572591.067576:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874405268501376:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572591.067610:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c738ce40 going to sleep for 11 seconds 00000100:00080000:0.0:1787572591.067735:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572591.081506:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874405268501248:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572591.081532:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14384:1874405268501376:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572591.081969:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572591.087247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572591.087287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572591.087758:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244395904 00000100:00100000:1.0:1787572591.087768:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244395904 00010000:00010000:1.0:1787572591.087809:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 23 pid: 15089 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572591.087883:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244396032 00000100:00100000:1.0:1787572591.087887:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244396032 00010000:00010000:1.0:1787572591.087904:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 24 pid: 14384 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572591.087935:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1787572591.087946:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1cdfe8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14621f29-0314-45be-9667-d365740545a2+24:2354:x1874405244395904:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572591.087962:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572591.087970:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 24 pid: 15089 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.087995:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 24 pid: 15089 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088021:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8a00/0x9fe530ef4f43787d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe51 expref: 24 pid: 15089 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088040:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:1.0:1787572591.088045:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088055:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088062:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572591.088119:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1cdfe8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14621f29-0314-45be-9667-d365740545a2+23:2354:x1874405244395904:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 174us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572591.088150:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1787572591.088375:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:1.0:1787572591.088383:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14621f29-0314-45be-9667-d365740545a2+22:2354:x1874405244396032:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572591.088392:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572591.088398:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 22 pid: 14384 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088409:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 22 pid: 14384 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088423:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb200/0x9fe530ef4f437868 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe4a expref: 22 pid: 14384 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088433:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:1.0:1787572591.088438:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088445:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088452:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.088475:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572591.088498:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14621f29-0314-45be-9667-d365740545a2+21:2354:x1874405244396032:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 115us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572591.088505:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00010000:00010000:2.0:1787572591.089681:0:14384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.089695:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787572591.089719:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787572591.089925:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe6d expref: 22 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.089947:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc276200/0x9fe530ef4f4378ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe6d expref: 21 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.089957:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:2.0:1787572591.089960:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787572591.089963:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc276200, rc 0) 00000100:00100000:2.0:1787572591.090023:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+21:14497:x1874405244395776:12345-192.168.204.55@tcp:101:dd.0 Request processed in 23019us (23315us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787572591.090033:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:2.0:1787572591.102448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572591.112363:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244396288 00000100:00100000:3.0:1787572591.112380:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244396288 00000100:00100000:2.0:1787572591.115994:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:2.0:1787572591.116011:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+21:14497:x1874405244396288:12345-192.168.204.55@tcp:36:dd.0 00010000:00010000:2.0:1787572591.116320:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.116339:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.116382:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572591.116440:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787572591.116478:0:14383:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001996e228 reply state 00000000028a8a3a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572591.116488:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787572591.116610:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+24:14497:x1874405244396288:12345-192.168.204.55@tcp:36:dd.0 Request processed in 602us (14170us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787572591.116618:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00000020:00080000:2.0:1787572591.116624:0:14383:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787572591.135999:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:2.0:1787572591.136133:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.136146:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.136154:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.136159:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1fc277600 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:2.0:1787572591.136165:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.136173:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.136192:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:2.0:1787572591.136195:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787572591.136231:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.136237:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572591.137848:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244396416 00000100:00100000:3.0:1787572591.137863:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244396416 00000100:00100000:3.0:1787572591.137944:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:3.0:1787572591.137957:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+23:14497:x1874405244396416:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:3.0:1787572591.137984:0:16006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572591.138004:0:16006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe74 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.138065:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe74 expref: 24 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.138078:0:16006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe74 expref: 24 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.138117:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:3.0:1787572591.138132:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787572591.138137:0:16006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c8000, rc 0) 00000100:00100000:3.0:1787572591.138208:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+24:14497:x1874405244396416:12345-192.168.204.55@tcp:101:dd.0 Request processed in 253us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572591.138215:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:3.0:1787572591.154312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572591.154432:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244396672 00000100:00100000:1.0:1787572591.154444:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244396672 00000100:00100000:0.0:1787572591.155017:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1787572591.155039:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14621f29-0314-45be-9667-d365740545a2+24:14497:x1874405244396672:12345-192.168.204.55@tcp:103:dd.0 00010000:00010000:0.0:1787572591.155058:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787572591.155088:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8000/0x9fe530ef4f4378df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe74 expref: 24 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572591.155109:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:0.0:1787572591.155114:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572591.155195:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14621f29-0314-45be-9667-d365740545a2+23:14497:x1874405244396672:12345-192.168.204.55@tcp:103:dd.0 Request processed in 168us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572591.155203:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:2.0:1787572591.164460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572591.165754:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244396800 00000100:00100000:1.0:1787572591.165770:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244396800 00000100:00100000:1.0:1787572591.165850:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:1.0:1787572591.165862:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+23:14497:x1874405244396800:12345-192.168.204.55@tcp:58:dd.0 00010000:00010000:1.0:1787572591.165970:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.165988:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.166000:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787572591.167072:0:14384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787572591.167247:0:14384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787572591.167323:0:14384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787572591.168386:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+23:14497:x1874405244396800:12345-192.168.204.55@tcp:58:dd.0 Request processed in 2519us (3933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572591.168399:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:1.0:1787572591.171462:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572591.171796:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244396928 00000100:00100000:2.0:1787572591.171806:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244396928 00000100:00100000:2.0:1787572591.171867:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:2.0:1787572591.171878:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+23:14497:x1874405244396928:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:2.0:1787572591.171900:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787572591.171920:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe7b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.171983:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.171995:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378ed lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe7b expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.172016:0:14383:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.172031:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378ed lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe7b expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.172046:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:2.0:1787572591.172049:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787572591.172053:0:14383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378ed lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe7b expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572591.172075:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1fc277600, rc 0) 00000100:00100000:2.0:1787572591.172158:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+24:14497:x1874405244396928:12345-192.168.204.55@tcp:101:dd.0 Request processed in 281us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572591.172165:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00010000:00010000:2.0:1787572591.471078:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572591.599489:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268501504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787572591.599574:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787572591.599691:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268501504 00000100:00100000:3.0:1787572591.599699:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268501504 00000100:00100000:3.0:1787572591.599759:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787572591.599769:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268501504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787572591.599808:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787572591.599864:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268501504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572591.599871:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787572591.599921:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268501504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787572591.600147:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787572591.658156:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:0.0:1787572591.658171:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1787572591.658183:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:0.0:1787572591.658196:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000040:00080000:2.0:1787572591.919314:0:14415:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787572591.919326:0:14415:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787572591.919367:0:14415:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787572591.919375:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787572591.919820:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14415:1874405268501632:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787572591.919933:0:14415:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c738c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787572591.923618:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14415:1874405268501632:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787572591.926493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572591.927390:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244397056 00000100:00100000:2.0:1787572591.927404:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244397056 00000100:00100000:2.0:1787572591.927463:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:2.0:1787572591.927473:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:14621f29-0314-45be-9667-d365740545a2+11:14498:x1874405244397056:12345-192.168.204.55@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787572591.927573:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:14621f29-0314-45be-9667-d365740545a2+11:14498:x1874405244397056:12345-192.168.204.55@tcp:900:lhsmtool_posix.0 Request processed in 101us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572591.927581:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:1.0:1787572591.937174:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572591.939284:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244397184 00000100:00100000:0.0:1787572591.939305:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244397184 00000100:00100000:0.0:1787572591.939414:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:0.0:1787572591.939429:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+11:14498:x1874405244397184:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787572591.939473:0:15089:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787572591.939862:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+11:14498:x1874405244397184:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 437us (2697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572591.939880:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:0.0:1787572591.953114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572591.953418:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244397312 00000100:00100000:1.0:1787572591.953429:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244397312 00000100:00100000:1.0:1787572591.953540:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:1.0:1787572591.953552:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+11:14498:x1874405244397312:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787572591.953627:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953716:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953730:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953748:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953756:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953763:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953788:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953796:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953801:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572591.953844:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787572591.953849:0:14384:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572591.953870:0:14384:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953881:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953898:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953905:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953911:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eaa00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572591.953915:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953923:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953935:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1e1353600) 00010000:00010000:1.0:1787572591.953938:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572591.953943:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953949:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f4378f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953963:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953968:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953973:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953977:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eba00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572591.953985:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953991:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.953998:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98d1d0b0b300) 00010000:00010000:1.0:1787572591.954001:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572591.954004:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.954010:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f4378fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.954027:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.954033:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.954048:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.954053:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572591.954055:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.954061:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.954067:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:1.0:1787572591.954070:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572591.954079:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.954084:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437902 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572591.954191:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+11:14498:x1874405244397312:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 641us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572591.954199:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:1.0:1787572591.961291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572591.961431:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244397568 00000100:00100000:3.0:1787572591.961443:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244397568 00000100:00100000:3.0:1787572591.961518:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:3.0:1787572591.961530:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+11:14498:x1874405244397568:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787572591.961552:0:16006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787572591.961736:0:16006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9e00/0x9fe530ef4f437909 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe82 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.961870:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.961885:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.961896:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787572591.961906:0:16006:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787572591.962037:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962046:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962053:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962059:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c8200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572591.962064:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962071:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962085:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:3.0:1787572591.962088:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787572591.962093:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962122:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437910 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962167:0:16006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9e00/0x9fe530ef4f437909 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe82 expref: 13 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962177:0:16006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d1e1353600) 00010000:00010000:3.0:1787572591.962179:0:16006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787572591.962183:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c9e00/0x9fe530ef4f437909 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe82 expref: 13 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572591.962191:0:16006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1c13c9e00, rc 0) 00000100:00100000:3.0:1787572591.962264:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+12:14498:x1874405244397568:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 736us (984us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787572591.962272:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:3.0:1787572591.970491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572591.974474:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244397696 00000100:00100000:0.0:1787572591.974492:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244397696 00000100:00100000:0.0:1787572591.974580:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:0.0:1787572591.974592:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+12:14498:x1874405244397696:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787572591.974630:0:15089:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787572591.974825:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+12:14498:x1874405244397696:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 234us (4355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572591.974834:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:0.0:1787572591.989740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572591.989837:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244397952 00000100:00100000:1.0:1787572591.989849:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244397952 00000100:00100000:1.0:1787572591.989909:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:1.0:1787572591.989920:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+12:14498:x1874405244397952:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572591.989943:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572591.989964:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f43791e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe89 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787572591.990863:0:14384:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1787572591.990872:0:14384:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1787572591.990923:0:14384:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787572591.991233:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f437925 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.991247:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f437925 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.991259:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f437925 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.991324:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f43791e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe89 expref: 15 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.991350:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f437925 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe89 expref: 14 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.991359:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0b300) 00010000:00010000:1.0:1787572591.991362:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787572591.991366:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eba00, rc 0) 00000100:00100000:1.0:1787572591.991445:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+14:14498:x1874405244397952:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1526us (1715us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787572591.991453:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1787572591.998302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572591.998381:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244398208 00000100:00100000:1.0:1787572591.998391:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244398208 00000100:00100000:1.0:1787572591.998450:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:1.0:1787572591.998460:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+14:14498:x1874405244398208:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787572591.998521:0:14385:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572591.998547:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f437925 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe89 expref: 14 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998576:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0b300) 00010000:00010000:1.0:1787572591.998585:0:14385:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572591.998606:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998619:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998628:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998689:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998696:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998703:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998940:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998948:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998955:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998960:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eaa00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572591.998964:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998972:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998981:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d1d0149500) 00010000:00010000:1.0:1787572591.998984:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572591.998987:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.998993:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eaa00/0x9fe530ef4f437933 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.999006:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.999012:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.999018:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.999022:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb800 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572591.999025:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.999031:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.999037:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd38344e2 (ffff98d1d0b0b700) 00010000:00010000:1.0:1787572591.999039:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787572591.999042:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572591.999047:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f43793a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd38344e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572591.999129:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+13:14498:x1874405244398208:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 669us (835us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787572591.999135:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:3.0:1787572592.001755:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.004831:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244398336 00000100:00100000:1.0:1787572592.004846:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244398336 00000100:00100000:1.0:1787572592.004932:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:1.0:1787572592.004958:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+13:14498:x1874405244398336:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572592.004986:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572592.005011:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437941 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe90 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.005054:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f437948 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.005068:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f437948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.005079:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f437948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.005193:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437941 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe90 expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.005214:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ea600/0x9fe530ef4f437948 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe90 expref: 14 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.005224:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572592.005226:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787572592.005230:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0ea600, rc 0) 00000100:00100000:1.0:1787572592.005301:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+14:14498:x1874405244398336:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 346us (3556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.005308:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:3.0:1787572592.014073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572592.014167:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244398592 00000100:00100000:0.0:1787572592.014180:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244398592 00000100:00100000:0.0:1787572592.014246:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:0.0:1787572592.014258:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+14:14498:x1874405244398592:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787572592.014341:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.014359:0:16006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.014373:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787572592.014863:0:16006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787572592.014874:0:16006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 522111238814ns, next at 523111236361ns, rc = 0 00000004:00010000:0.0:1787572592.014966:0:16006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a459c93 reply state 000000001aea44d0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.014982:0:16006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787572592.015078:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+16:14498:x1874405244398592:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 822us (1444us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787572592.015086:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00010000:00010000:3.0:1787572592.018158:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.018174:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.018182:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.018204:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30e00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572592.018209:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.018227:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.018245:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572592.018248:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787572592.018253:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.018259:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30e00/0x9fe530ef4f43794f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572592.019966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572592.020151:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244398720 00000100:00100000:0.0:1787572592.020161:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244398720 00000100:00100000:0.0:1787572592.020242:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1787572592.020253:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+15:14498:x1874405244398720:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572592.020279:0:15089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572592.020298:0:15089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe97 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.020369:0:15089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 16 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.020383:0:15089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 16 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.020404:0:15089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:0.0:1787572592.020407:0:15089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787572592.020411:0:15089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30200, rc 0) 00000100:00100000:0.0:1787572592.020469:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+16:14498:x1874405244398720:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 219us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572592.020477:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1787572592.023799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572592.023884:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244398848 00000100:00100000:3.0:1787572592.023894:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244398848 00000100:00100000:3.0:1787572592.023967:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1787572592.023977:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244398848:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787572592.024352:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14621f29-0314-45be-9667-d365740545a2+6:2354:x1874405244398848:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 376us (561us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787572592.024360:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00080000:1.0:1787572592.024441:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787572592.027290:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.027536:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244399104 00000100:00100000:1.0:1787572592.027547:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244399104 00000100:00100000:1.0:1787572592.027625:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1787572592.027678:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+16:14498:x1874405244399104:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787572592.027944:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+17:14498:x1874405244399104:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 309us (661us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787572592.027952:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:0.0:1787572592.030961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572592.031056:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244399360 00000100:00100000:3.0:1787572592.031067:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244399360 00000100:00100000:3.0:1787572592.031134:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1787572592.031144:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+17:14498:x1874405244399360:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787572592.031282:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+17:14498:x1874405244399360:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 139us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572592.031290:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1787572592.037746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.038006:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244399488 00000100:00100000:1.0:1787572592.038019:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244399488 00000100:00100000:1.0:1787572592.038073:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:1.0:1787572592.038084:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+17:14498:x1874405244399488:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572592.038121:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572592.038143:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f43795d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbe9e expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.038234:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f437964 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.038248:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f437964 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.038259:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f437964 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787572592.038299:0:14385:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787572592.038319:0:14385:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f437964 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.038349:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f43795d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe9e expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.038387:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f437964 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe9e expref: 18 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.038396:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572592.038399:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787572592.038402:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eb800, rc 0) 00000100:00100000:1.0:1787572592.038470:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+18:14498:x1874405244399488:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 388us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.038477:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:2.0:1787572592.042180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.042257:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244399616 00000100:00100000:1.0:1787572592.042268:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244399616 00000100:00100000:1.0:1787572592.042327:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:1.0:1787572592.042338:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14621f29-0314-45be-9667-d365740545a2+6:2353:x1874405244399616:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787572592.042357:0:15067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787572592.042378:0:15067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbea5 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787572592.042405:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c316e, blocks: 0x1 00010000:00010000:1.0:1787572592.042426:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1787572592.042431:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572592.042442:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 7 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.042463:0:15067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 7 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.042497:0:15067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1de0eaa00, rc 0) 00000100:00100000:1.0:1787572592.042573:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14621f29-0314-45be-9667-d365740545a2+7:2353:x1874405244399616:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 236us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.042580:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1787572592.046010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.046127:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244399872 00000100:00100000:1.0:1787572592.046139:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244399872 00000100:00100000:1.0:1787572592.046199:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:1.0:1787572592.046210:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+18:14498:x1874405244399872:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787572592.046334:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14621f29-0314-45be-9667-d365740545a2+18:14498:x1874405244399872:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.046342:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:0.0:1787572592.049676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572592.049824:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244400000 00000100:00100000:3.0:1787572592.049834:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244400000 00000100:00100000:3.0:1787572592.049888:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:3.0:1787572592.049898:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+18:14498:x1874405244400000:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787572592.084403:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1787572592.084417:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787572592.084441:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1787572592.084628:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787572592.084670:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268501760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787572592.084748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572592.085047:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268501760 00000100:00100000:1.0:1787572592.085056:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268501760 00000100:00100000:1.0:1787572592.085132:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787572592.085143:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874405268501760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787572592.085298:0:15068:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787572592.085302:0:15068:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787572592.085304:0:15068:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787572592.085307:0:15068:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787572590 -> 1787572590 00002000:00010000:1.0:1787572592.085309:0:15068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787572592.085353:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874405268501760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (605us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787572592.085374:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787572592.085425:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d1fc4edf80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787572592.085431:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874405268501760:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1787572592.085489:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787572592.085778:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14621f29-0314-45be-9667-d365740545a2+14:14498:x1874405244400000:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 35879us (36109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572592.085788:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:3.0:1787572592.088684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.088760:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244400128 00000100:00100000:1.0:1787572592.088771:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244400128 00000100:00100000:1.0:1787572592.088833:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1787572592.088844:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14621f29-0314-45be-9667-d365740545a2+7:2354:x1874405244400128:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787572592.089225:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14621f29-0314-45be-9667-d365740545a2+7:2354:x1874405244400128:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 382us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.089234:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:3.0:1787572592.091926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.092095:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244400384 00000100:00100000:1.0:1787572592.092117:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244400384 00000100:00100000:1.0:1787572592.092185:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:1.0:1787572592.092195:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+14:14498:x1874405244400384:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787572592.092250:0:15089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572592.092279:0:15089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb800/0x9fe530ef4f437964 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe9e expref: 14 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.092300:0:15089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572592.092305:0:15089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787572592.092335:0:15089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.092348:0:15089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.092357:0:15089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787572592.092581:0:15089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cfddf5c reply state 0000000090defad2 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572592.092591:0:15089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787572592.092727:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14621f29-0314-45be-9667-d365740545a2+15:14498:x1874405244400384:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 533us (810us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787572592.092735:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:2.0:1787572592.096172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:3.0:1787572592.096703:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.096717:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.096725:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.096731:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebc00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572592.096736:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.096744:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.096762:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:3.0:1787572592.096765:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572592.096778:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.096784:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0ebc00/0x9fe530ef4f437972 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.097117:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244400512 00000100:00100000:0.0:1787572592.097131:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244400512 00000100:00100000:0.0:1787572592.097204:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:0.0:1787572592.097215:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14621f29-0314-45be-9667-d365740545a2+7:14498:x1874405244400512:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787572592.097234:0:15068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787572592.097250:0:15068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf566153e151dbeac expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.097279:0:15068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 8 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.097286:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.097291:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.097295:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 8 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.097332:0:15068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 8 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.097346:0:15068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 8 pid: 15067 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.097375:0:15068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d0c5d55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15068:1874405268501888:192.168.204.55@tcp:104: 00000100:00100000:0.0:1787572592.097463:0:15068:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cde2cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787572592.101441:0:15068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d0c5d55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15068:1874405268501888:192.168.204.55@tcp:104: 00010000:00010000:1.0:1787572592.101487:0:15068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 8 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.101507:0:15068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d1d0a30a00, rc 0) 00000100:00100000:1.0:1787572592.101629:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14621f29-0314-45be-9667-d365740545a2+8:14498:x1874405244400512:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 4415us (5466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.101727:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:0.0:1787572592.104987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572592.105079:0:16502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244400640 00000100:00100000:2.0:1787572592.105091:0:16502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244400640 00010000:00010000:2.0:1787572592.105153:0:16502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 8 pid: 15067 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572592.105242:0:16502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1787572592.105254:0:16502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14621f29-0314-45be-9667-d365740545a2+8:2354:x1874405244400640:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787572592.105271:0:16502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787572592.105301:0:16502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 8 pid: 15067 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.105317:0:16502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 8 pid: 15067 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.105342:0:16502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006440323f/0x9fe530ef4f43796b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbea5 expref: 8 pid: 15067 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.105359:0:16502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572592.105364:0:16502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787572592.105372:0:16502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 7 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.105383:0:16502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 7 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.105426:0:16502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 7 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572592.105457:0:16502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16502:1874405268502016:192.168.204.55@tcp:105: 00000100:00100000:2.0:1787572592.105540:0:16502:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d0c738c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787572592.110044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572592.110130:0:16613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244400768 00000100:00100000:3.0:1787572592.110140:0:16613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244400768 00000100:00100000:3.0:1787572592.110203:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:3.0:1787572592.110215:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14621f29-0314-45be-9667-d365740545a2+8:2353:x1874405244400768:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787572592.110449:0:16613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787572592.110452:0:16613:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787572589 00002000:00010000:3.0:1787572592.110455:0:16613:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787572588 00002000:00010000:3.0:1787572592.110457:0:16613:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787572590 -> 1787572589 00002000:00010000:3.0:1787572592.110460:0:16613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787572592.110526:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14621f29-0314-45be-9667-d365740545a2+9:2353:x1874405244400768:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 313us (492us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787572592.110535:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1787572592.112716:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268502528:0@lo:400:kworker.0 00000100:00100000:2.0:1787572592.112784:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572592.112841:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787572592.112847:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268502400:0@lo:400:kworker.0 00000100:00100000:2.0:1787572592.112871:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572592.112902:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268502528 00000100:00100000:2.0:1787572592.112909:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268502528 00000100:00100000:2.0:1787572592.112977:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268502400 00000100:00100000:2.0:1787572592.112981:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268502400 00000100:00100000:2.0:1787572592.113008:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787572592.113017:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268502528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572592.113067:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874405268502528:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572592.113075:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787572592.113093:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787572592.113099:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268502400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572592.113138:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874405268502400:12345-0@lo:400:kworker.0 Request processed in 39us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572592.113144:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787572592.113161:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787572592.113191:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874405268502400:0@lo:400:kworker.0 00000100:00100000:2.0:1787572592.113221:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874405268502528:0@lo:400:kworker.0 00000100:00100000:1.0:1787572592.113583:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268502272:0@lo:400:kworker.0 00000100:00100000:1.0:1787572592.113619:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572592.113671:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787572592.113677:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268502144:0@lo:400:kworker.0 00000100:00100000:1.0:1787572592.113705:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572592.113731:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268502656:0@lo:400:kworker.0 00000100:00100000:1.0:1787572592.113752:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787572592.113775:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268502656 00000100:00100000:1.0:1787572592.113779:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268502656 00000100:00100000:1.0:1787572592.113823:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787572592.113837:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268502656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572592.113875:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874405268502656:12345-0@lo:400:kworker.0 Request processed in 38us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.113881:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787572592.113903:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268502144 00000100:00100000:1.0:1787572592.113906:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268502144 00000100:00100000:1.0:1787572592.113931:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787572592.113937:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3311:x1874405268502144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787572592.113965:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39be3db9-5eba-42e2-9087-a4df3ec904cb+19:3311:x1874405268502144:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.113970:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787572592.113997:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787572592.114015:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39be3db9-5eba-42e2-9087-a4df3ec904cb:3311:1874405268502144:0@lo:400:kworker.0 00000100:00100000:1.0:1787572592.114025:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874405268502656:0@lo:400:kworker.0 00000100:00100000:2.0:1787572592.114497:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268502272 00000100:00100000:2.0:1787572592.114503:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268502272 00000100:00100000:2.0:1787572592.114532:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572592.114540:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268502272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787572592.114591:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874405268502272:12345-0@lo:400:kworker.0 Request processed in 53us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572592.114598:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787572592.114940:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787572592.114953:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268502784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787572592.114993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572592.115069:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268502784 00000100:00100000:2.0:1787572592.115074:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268502784 00000100:00100000:2.0:1787572592.115119:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572592.115127:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268502784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787572592.115158:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787572592.115200:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874405268502784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572592.115206:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787572592.115243:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874405268502784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787572592.115343:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874405268502272:0@lo:400:kworker.0 00000100:00100000:1.0:1787572592.116786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572592.116887:0:16613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244400896 00000100:00100000:3.0:1787572592.116895:0:16613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244400896 00000100:00100000:3.0:1787572592.116938:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:3.0:1787572592.116947:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14621f29-0314-45be-9667-d365740545a2+9:2354:x1874405244400896:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787572592.116985:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.117024:0:16613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 9 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.117032:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572592.117036:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787572592.117040:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.117071:0:16613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 9 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.117354:0:16502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16502:1874405268502016:192.168.204.55@tcp:105: 00010000:00010000:0.0:1787572592.117376:0:16502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787572592.117453:0:16502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14621f29-0314-45be-9667-d365740545a2+9:2354:x1874405244400640:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 12201us (12476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572592.117462:0:16502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00010000:00010000:3.0:1787572592.118598:0:16613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 8 pid: 15068 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572592.118622:0:16613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f4512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16613:1874405268502912:192.168.204.55@tcp:104: 00000100:00100000:2.0:1787572592.119031:0:16613:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1cebc43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787572592.123315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.123350:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244401024 00000100:00100000:1.0:1787572592.123360:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244401024 00010000:00010000:1.0:1787572592.123401:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 9 pid: 15068 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572592.123440:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:1.0:1787572592.123450:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14621f29-0314-45be-9667-d365740545a2+9:2353:x1874405244401024:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572592.123464:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572592.123499:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 9 pid: 15068 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.123514:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 9 pid: 15068 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.123540:0:14371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787572592.123545:0:14371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787572592.123561:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.123572:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.123594:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572592.123659:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14621f29-0314-45be-9667-d365740545a2+9:2353:x1874405244401024:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 210us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.123666:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00010000:00010000:0.0:1787572592.123868:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004820a75b/0x9fe530ef4f437979 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbeac expref: 8 pid: 15068 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.123884:0:16613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f4512a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16613:1874405268502912:192.168.204.55@tcp:104: 00010000:00010000:0.0:1787572592.123912:0:16613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.123924:0:16613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.123943:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.123967:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.123987:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.123994:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.124001:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9e00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572592.124005:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.124013:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.124024:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.124031:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe337758/0x9fe530ef4f437980 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.124089:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14621f29-0314-45be-9667-d365740545a2+7:2354:x1874405244400896:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 7144us (7308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572592.124096:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:1.0:1787572592.130386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.130426:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244401280 00000100:00100000:1.0:1787572592.130436:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244401280 00000100:00100000:1.0:1787572592.130491:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:1.0:1787572592.130502:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+14:14498:x1874405244401280:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787572592.130601:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.130621:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.130662:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.131195:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.131208:0:14385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 15 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.131218:0:14385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.131254:0:14385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 15 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.131269:0:14385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 15 pid: 15089 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572592.131283:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14385:1874405268503040:192.168.204.55@tcp:104: 00000100:00100000:1.0:1787572592.131698:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e75cee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787572592.146743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572592.147212:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14385:1874405268503040:192.168.204.55@tcp:104: 00010000:00010000:3.0:1787572592.147242:0:14385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572592.148085:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244401408 00000100:00100000:1.0:1787572592.148096:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244401408 00010000:00010000:1.0:1787572592.148148:0:14370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 16 pid: 15089 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572592.148184:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1787572592.148194:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14621f29-0314-45be-9667-d365740545a2+16:2353:x1874405244401408:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787572592.148220:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787572592.148228:0:14370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 16 pid: 15089 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.148240:0:14370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 16 pid: 15089 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.148273:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1d0a30200/0x9fe530ef4f437956 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe97 expref: 16 pid: 15089 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.148289:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572592.148294:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.148304:0:14370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.148311:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.148330:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787572592.148380:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14621f29-0314-45be-9667-d365740545a2+15:2353:x1874405244401408:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 187us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572592.148388:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00010000:00010000:2.0:1787572592.150232:0:14385:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.150258:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787572592.150463:0:14385:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787572592.150624:0:14385:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787572592.150712:0:14385:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787572592.150804:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14385:1874405268503168:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787572592.150883:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572592.150914:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4adacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572592.151159:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268503168 00000100:00100000:0.0:1787572592.151167:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268503168 00000100:00100000:0.0:1787572592.151223:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787572592.151241:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14385:x1874405268503168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787572592.151312:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14385:x1874405268503168:12345-0@lo:1000:mdt00_002.0 Request processed in 73us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572592.151319:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787572592.151869:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14385:1874405268503168:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787572592.152524:0:14385:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787572592.152603:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1f40ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14385:1874405268503296:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787572592.153431:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787572592.153516:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1f4ada0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572592.154208:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405268503296 00000100:00100000:0.0:1787572592.154217:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405268503296 00000100:00100000:3.0:1787572592.155790:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787572592.155802:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14385:x1874405268503296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787572592.156351:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14385:x1874405268503296:12345-0@lo:1000:mdt00_002.0 Request processed in 549us (2920us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787572592.156359:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787572592.156734:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1f40ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14385:1874405268503296:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787572592.156780:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.156791:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157123:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157133:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eba00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572592.157138:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157146:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157162:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:1.0:1787572592.157165:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787572592.157170:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157177:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43798e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157209:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157215:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157220:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157225:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eac00 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:1.0:1787572592.157228:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157245:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157254:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:1.0:1787572592.157256:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787572592.157263:0:14385:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe7b expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157273:0:14385:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378ed lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe7b expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157281:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe7b expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.157320:0:14385:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d1fc277600/0x9fe530ef4f4378ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0xf566153e151dbe7b expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572592.157335:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98d1fc4ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14385:1874405268503424:192.168.204.55@tcp:105: 00000100:00100000:1.0:1787572592.157489:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff98d1e75ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787572592.163088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572592.163133:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244401536 00000100:00100000:0.0:1787572592.163141:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244401536 00000100:00100000:0.0:1787572592.163211:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1787572592.163222:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1c3d69450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+19:14497:x1874405244401536:12345-192.168.204.55@tcp:49:dd.0 00000100:00100000:0.0:1787572592.163361:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1c3d69450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+19:14497:x1874405244401536:12345-192.168.204.55@tcp:49:dd.0 Request processed in 140us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572592.163368:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1787572592.163786:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98d1fc4ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14385:1874405268503424:192.168.204.55@tcp:105: 00010000:00010000:3.0:1787572592.163865:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163877:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eac00/0x9fe530ef4f4378e6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163907:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163924:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163936:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163946:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163952:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163959:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163965:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c8200 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572592.163969:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163977:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.163988:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:3.0:1787572592.163999:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787572592.164004:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.164010:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1c13c8200/0x9fe530ef4f437995 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.164020:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.164025:0:14385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.164031:0:14385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.164036:0:14385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eb400 already unused, calling callback (ffffffffc20584f0) 00010000:00010000:3.0:1787572592.164039:0:14385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.164045:0:14385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.164052:0:14385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d1d0b0b000) 00010000:00010000:3.0:1787572592.164055:0:14385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787572592.164057:0:14385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.164063:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eb400/0x9fe530ef4f437987 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14385 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572592.164855:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14621f29-0314-45be-9667-d365740545a2+18:14498:x1874405244401280:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 34349us (34472us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787572592.165031:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000020:00080000:3.0:1787572592.165037:0:14385:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787572592.165172:0:14415:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787572592.165177:0:14415:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787572592.165207:0:14415:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787572592.165213:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:1.0:1787572592.170581:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1787572592.170599:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:0.0:1787572592.173526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572592.173614:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244401792 00000100:00100000:1.0:1787572592.173623:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244401792 00000100:00100000:1.0:1787572592.173707:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1787572592.173717:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+18:14498:x1874405244401792:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787572592.174398:0:14386:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787572592.174514:0:14386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1787572592.174553:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.174570:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.174582:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.174590:0:14386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.174596:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.174601:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.174629:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787572592.174743:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14621f29-0314-45be-9667-d365740545a2+20:14498:x1874405244401792:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1025us (1224us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787572592.174751:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000020:00080000:1.0:1787572592.174756:0:14386:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787572592.175016:0:15598:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787572592.175024:0:15598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.175032:0:15598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0eba00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:2.0:1787572592.175036:0:15598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.175044:0:15598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.175057:0:15598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d1d0b0ba00) 00010000:00010000:2.0:1787572592.175060:0:15598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787572592.175064:0:15598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.175070:0:15598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d1de0eba00/0x9fe530ef4f43799c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787572592.175079:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572592.175081:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787572592.175091:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787572592.370235:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572592.370413:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244401920 00000100:00100000:0.0:1787572592.370423:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244401920 00000100:00100000:0.0:1787572592.370494:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:0.0:1787572592.370505:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14621f29-0314-45be-9667-d365740545a2+5:2355:x1874405244401920:12345-192.168.204.55@tcp:4:dd.0 00002000:00010000:0.0:1787572592.370565:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c316d, atime: 0x6a8c316c, ctime: 0x6a8c316d, blocks: 0x1 00010000:00010000:0.0:1787572592.370575:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.370591:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=522s v=(0 0) 00010000:00010000:0.0:1787572592.370596:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.370602:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.370660:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572592.376690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1787572592.378713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572592.380759:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787572592.381458:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787572592.383310:0:15073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787572592.383620:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244402048 00000100:00100000:2.0:1787572592.383632:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244402048 00000100:00100000:2.0:1787572592.385394:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787572592.385409:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244402176 00000100:00100000:2.0:1787572592.385415:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244402176 00000100:00100000:3.0:1787572592.388192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572592.388293:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787572592.388305:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244402304 00000100:00100000:2.0:1787572592.388315:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244402304 00000100:00100000:3.0:1787572592.390385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572592.391719:0:15073:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787572592.391738:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244402432 00000100:00100000:2.0:1787572592.391753:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244402432 00000100:00100000:1.0:1787572592.393006:0:16617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:1.0:1787572592.393022:0:16617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14621f29-0314-45be-9667-d365740545a2+10:2356:x1874405244402048:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:1.0:1787572592.393061:0:16617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.393078:0:16617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572592.393083:0:16617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572592.393108:0:16617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.393124:0:16617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572592.393374:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572592.393421:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572592.393503:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787572592.393512:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787572592.394338:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244402560 00000100:00100000:2.0:1787572592.394347:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244402560 00000100:00100000:2.0:1787572592.394400:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787572592.394407:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244402688 00000100:00100000:2.0:1787572592.394410:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244402688 00000100:00100000:0.0:1787572592.394898:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1787572592.394911:0:16618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14621f29-0314-45be-9667-d365740545a2+12:2355:x1874405244402176:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:0.0:1787572592.394939:0:16618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.394955:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.394958:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.394964:0:16618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.394977:0:16618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787572592.401050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572592.401122:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787572592.401134:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1787572592.401402:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244402816 00000100:00100000:2.0:1787572592.401413:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244402816 00000100:00100000:0.0:1787572592.402396:0:16619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:0.0:1787572592.402413:0:16619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:14621f29-0314-45be-9667-d365740545a2+15:2355:x1874405244402304:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:0.0:1787572592.402458:0:16619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.402487:0:16619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.402491:0:16619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.402498:0:16619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.402512:0:16619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787572592.481021:0:16617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1787572592.481037:0:16617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787572589 -> 1787572590 00002000:00010000:0.0:1787572592.481040:0:16617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787572589 -> 1787572590 00002000:00010000:0.0:1787572592.481043:0:16617:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:0.0:1787572592.481067:0:16617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.481084:0:16617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.481103:0:16617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.481111:0:16617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ea400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572592.481116:0:16617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.481125:0:16617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.481163:0:16617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.481171:0:16617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e82675d2/0x9fe530ef4f4379aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.481270:0:16617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14621f29-0314-45be-9667-d365740545a2+23:2356:x1874405244402048:12345-192.168.204.55@tcp:4:dd.0 Request processed in 88246us (104585us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787572592.481281:0:16617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1787572592.481319:0:16617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:0.0:1787572592.481333:0:16617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14621f29-0314-45be-9667-d365740545a2+22:2355:x1874405244402432:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:0.0:1787572592.481370:0:16617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.481383:0:16617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.481388:0:16617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787572592.481394:0:16617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.481405:0:16617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481690:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481701:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481709:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481717:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572592.481721:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481729:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481755:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481761:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005930a75b/0x9fe530ef4f4379a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572592.481802:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14621f29-0314-45be-9667-d365740545a2+21:2355:x1874405244401920:12345-192.168.204.55@tcp:4:dd.0 Request processed in 111298us (111575us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787572592.481814:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1787572592.481834:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1787572592.481841:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14621f29-0314-45be-9667-d365740545a2+20:2355:x1874405244402560:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:3.0:1787572592.481859:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481868:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572592.481872:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572592.481876:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.481885:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482438:0:16618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482450:0:16618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482458:0:16618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482465:0:16618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30400 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572592.482469:0:16618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482477:0:16618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482490:0:16618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482497:0:16618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f1526ff/0x9fe530ef4f4379b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572592.482561:0:16618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14621f29-0314-45be-9667-d365740545a2+20:2355:x1874405244402176:12345-192.168.204.55@tcp:4:dd.0 Request processed in 87653us (103855us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787572592.482570:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:1.0:1787572592.482592:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:1.0:1787572592.482601:0:16618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14621f29-0314-45be-9667-d365740545a2+19:2355:x1874405244402688:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:1.0:1787572592.482617:0:16618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482627:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572592.482630:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787572592.482676:0:16618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.482687:0:16618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787572592.482774:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1787572592.482790:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:1.0:1787572592.482804:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:2.0:1787572592.497185:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787572592.545517:0:16619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:3.0:1787572592.545526:0:16619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1787572592.545542:0:16619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.545564:0:16619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.545574:0:16619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.545582:0:16619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a31a00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572592.545586:0:16619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.545595:0:16619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.545619:0:16619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.545627:0:16619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fdcec56/0x9fe530ef4f4379b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572592.545747:0:16619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:14621f29-0314-45be-9667-d365740545a2+18:2355:x1874405244402304:12345-192.168.204.55@tcp:4:dd.0 Request processed in 143334us (157561us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787572592.545759:0:16619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:3.0:1787572592.545795:0:16619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1787572592.545809:0:16619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f40edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:14621f29-0314-45be-9667-d365740545a2+17:2355:x1874405244402816:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:3.0:1787572592.545904:0:16619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.545925:0:16619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572592.545929:0:16619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787572592.545936:0:16619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.545949:0:16619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787572592.546186:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:3.0:1787572592.629247:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1787572592.630489:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1787572592.630577:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:0.0:1787572592.630593:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.630612:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.630618:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.630623:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c8200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572592.630628:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.630646:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.630665:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.630671:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dab08609/0x9fe530ef4f4379c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.630781:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14621f29-0314-45be-9667-d365740545a2+15:2355:x1874405244402560:12345-192.168.204.55@tcp:4:dd.0 Request processed in 148932us (237404us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787572592.630791:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00002000:00010000:1.0:1787572592.636348:0:16618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1787572592.636376:0:16618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.636390:0:16618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.636414:0:16618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.636422:0:16618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1de0ebe00 already unused, calling callback (ffffffffc1619230) 00010000:00010000:1.0:1787572592.636429:0:16618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.636438:0:16618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.636466:0:16618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787572592.636474:0:16618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d5acb01/0x9fe530ef4f4379cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787572592.636579:0:16618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14621f29-0314-45be-9667-d365740545a2+13:2355:x1874405244402688:12345-192.168.204.55@tcp:4:dd.0 Request processed in 153973us (243152us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787572592.636590:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00010000:00010000:3.0:1787572592.661622:0:16619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.661668:0:16619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.661678:0:16619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.661685:0:16619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1c13c9800 already unused, calling callback (ffffffffc1619230) 00010000:00010000:3.0:1787572592.661691:0:16619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.661700:0:16619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.661739:0:16619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787572592.661747:0:16619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a155f2a2/0x9fe530ef4f4379d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787572592.661858:0:16619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f40edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:14621f29-0314-45be-9667-d365740545a2+11:2355:x1874405244402816:12345-192.168.204.55@tcp:4:dd.0 Request processed in 116046us (260809us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787572592.661869:0:16619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000001:00080000:3.0:1787572592.661910:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:3.0:1787572592.661927:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1787572592.662050:0:16617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.662074:0:16617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.662082:0:16617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.662100:0:16617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d1d0a30200 already unused, calling callback (ffffffffc1619230) 00010000:00010000:0.0:1787572592.662105:0:16617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.662114:0:16617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.662126:0:16617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787572592.662133:0:16617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c821a8c1/0x9fe530ef4f4379bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787572592.662181:0:16617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14621f29-0314-45be-9667-d365740545a2+5:2355:x1874405244402432:12345-192.168.204.55@tcp:4:dd.0 Request processed in 180852us (271804us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787572592.662189:0:16617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00010000:00010000:2.0:1787572593.519050:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787572594.494253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572594.494303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572594.494355:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244403072 00000100:00100000:0.0:1787572594.494374:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244403072 00000100:00100000:0.0:1787572594.494435:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:0.0:1787572594.494452:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+20:2353:x1874405244403072:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1787572594.494528:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14621f29-0314-45be-9667-d365740545a2+20:2353:x1874405244403072:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572594.494536:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00080000:0.0:1787572594.494567:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787572594.494750:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244402944 00000100:00100000:3.0:1787572594.494755:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244402944 00000100:00100000:3.0:1787572594.494794:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:3.0:1787572594.494801:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:2354:x1874405244402944:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1787572594.494831:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:421f0569-d5e2-4cf9-9e4f-1bf96b25c6eb+13:2354:x1874405244402944:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 32us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787572594.494837:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:0.0:1787572594.496012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572594.496063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572594.496088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1787572594.496377:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244403200 00000100:00100000:0.0:1787572594.496386:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244403200 00000100:00100000:0.0:1787572594.496435:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244403712 00000100:00100000:0.0:1787572594.496438:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244403712 00000100:00100000:0.0:1787572594.496467:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:0.0:1787572594.496476:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244403200:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572594.496682:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244403456 00000100:00100000:1.0:1787572594.496687:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244403456 00000100:00100000:1.0:1787572594.496718:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:1.0:1787572594.496725:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2354:x1874405244403456:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572594.496848:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+6:2354:x1874405244403456:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 122us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572594.496863:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:1.0:1787572594.496887:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1787572594.496970:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d0c5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244403712:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572594.496995:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2354:x1874405244403712:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 30us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572594.497002:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00080000:1.0:1787572594.497125:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787572594.497129:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787572594.497132:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787572594.498127:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d0c5d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14621f29-0314-45be-9667-d365740545a2+5:2354:x1874405244403200:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 1560us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787572594.498141:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:3.0:1787572594.504997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1787572594.505247:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244403328 00000100:00100000:1.0:1787572594.505260:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244403328 00000100:00100000:1.0:1787572594.505377:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:1.0:1787572594.505388:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1f4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14621f29-0314-45be-9667-d365740545a2+5:2353:x1874405244403328:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1787572594.505467:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1f4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14621f29-0314-45be-9667-d365740545a2+5:2353:x1874405244403328:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 81us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787572594.505475:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00080000:2.0:1787572594.508498:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787572594.512149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1787572594.512227:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874405244403584 00000100:00100000:2.0:1787572594.512240:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874405244403584 00000100:00100000:2.0:1787572594.512319:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1787572594.512330:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d1fc4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2353:x1874405244403584:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1787572594.512411:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d1fc4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ed6e9a4-830e-4356-86ba-b5ac597b7c6f+5:2353:x1874405244403584:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787572594.512426:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00080000:1.0:1787572594.512477:0:14380:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787572594.542848:0:15598:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787572594.577124:0:16657:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787572595.566810:0:14373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787572596.594674:0:14372:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29953 lines, 29953 kept, 0 dropped, 0 bad.